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COMPARING THE EFFICIENCY OF SPECIAL TEACHING 
METHODS BY MEANS OF STANDARDIZED TESTS! 


SAMUEL S. Brooks 


District Superintendent, Winchester, New Hampshire 


In the last article five principal factors in a teacher’s efficiency 
were distinguished—namely, (1) managing ability, (2) natural 
aptitude, (3) method of teaching, (4) interest and industry, and 
‘) personality. The position was taken that no one of these five 
factors can be accurately and objectively measured independently 
of any or all of the other factors. 

Although method was one of the factors mentioned we never- 
theless now propose to measure the efficiency of methods. Note, 
however, that we do not propose to do so independently of the 
other factors. 

In general the efficiency of a teacher and the efficiency of her 
methods are pretty much inseparable. It is a mooted question 
whether or not there can be a good teacher without good teaching 
methods. We hear it argued, for example, that a good teacher 
with a poor method will accomplish more than a poor teacher 
with a good method. This argument implies that good teachers 
using poor methods may secure better results than poor teachers 
using good methods, in the same way that a good carpenter with 
few and poor tools can do a better job than can the novice with 
the best and most complete set of tools obtainable. We must 
admit that there is much truth in the argument. Sometimes we 
find that a teacher who is ignorant of approved methods but who 
has great natural ability is obtaining better results than another 
teacher who is without natural aptitude but who, perhaps with all 
the advantages of normal training, is using or rather misusing, 

'This is the seventh article by Superintendent Brooks on the general topic, 
Putting Standardized Tests to Practical Use in Rural Schools.” 
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the most approved modern methods. One has the true tea: hing 
instinct and ability to apply general principles and the other lack: 
these advantages. 

Whatever may be the actual relations between good and poor 
teachers and good and poor methods, we can all agree, I thin! 
that the best teachers are those who combine natural aptituc 
with thorough knowledge of up-to-date methods together 
skill in applying them so as to realize their possibilities. And 
although we cannot measure the efficiency of a teacher’s meth: 
entirely apart from consideration of her general ability, there is 
way, nevertheless, by which we can with the help of standardized 
tests obtain fairly accurate comparisons of the efficie 
various special methods, taking at the same time full cognizanc: 
of the teacher’s general ability. 

This can be done somewhat as we solve simultaneous equations 
in algebra—that is, by manipulating the various quantities so as 
to eliminate all but one of the unknowns. The value of 
remaining unknown is readily found after the others are equalized 

so as to cancel each other. Yet it cannot be said that the elimi 
nated quantities are ignored. The manipulations required to bring 
about the conditions suitable for their elimination give them their 
full force in evaluating the result. 

And so, if we are to find the relative values of two or mor 
special teaching methods, we must equalize as far as possible 
the conditions under which those methods are tried out, thus 
eliminating all the unknown quantities but one. The chief 
these external conditions that would affect the accuracy of our 
results are the general ability of the teachers, the average mental 
abilities of the several groups of pupils, and the time devoted to 
class work with the method. 

Now, there are two ways in which we may want to compare 
nethods. We may want to discover which of two or more special 
methods of teaching a subject will give the best results when used I 
by teachers of equal general ability or we may want to learn which | 
of two or more special methods can be used to best advantage by 5 
a certain teacher. a 

To illustrate the first case, suppose we wanted to compare the 
results of drill in the fundamental operations of arithmetic as con- ‘ 
ducted in the usual more or less unorganized manner and without : 
much regard for the special difficulties involved in definite types o! ; 
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mples, with results of drill in the same operations by means of 
‘ourtis Standard Practice Tests. To do this we should first 
mur teachers for the trial. Their general ability should be as 
jual as possible in order to eliminate so far as may be any 
cy in our conclusions due to differences in ability. Two 

with approximately equal ratings by the method de- 


‘xperience with, and if possible no knowledge of, the Cour- 
Standard Practice Tests or of similar practice material, while 
er should have had experience in their use and knowledge of 
sic principles. It would not do to have the same teacher 
handle both methods because, on the one hand, if she had 
.d experience with the practice tests, the defects of the haphazard 
edure would be largely nullified by her knowledge of the 
inciples underlying them; while, on the other hand, if she did not 
such knowledge and experience, the advantages of the Cour- 
ethod would in some measure be lost. 
[he next step is to choose two groups of pupils. These groups 
| be neither too large nor too small; neither large enough to 
e cumbersome to handle as a class nor small enough to make 
verage scores meaningless. From ten or twelve to twenty in a 
p is probably about right. The pupils in both groups should 
be in the same grade, and the average mental ages and average 
intelligence quotients of the two groups should be as nearly equal 
is possible. The pupils’ mental ages and intelligence quotients 
ire obtained of course by means of intelligence tests, some uses 


f which will be discussed in a later article. 

As soon as the pupils have been selected, they should be care- 
fully tested by means of standardized tests in the fundamentals, 
and their scores should be recorded. The testing of both groups 
and the scoring of the papers should be done by the same person, 
preferably a person experienced in such work. The period of 
should begin as soon as the tests have been given. Care 
should be taken to see that, in each group, exactly the same 
amount of time is devoted to drill in the fundamental operations 
each day. At the end of eight or ten weeks the tests should be 
given again, the scores recorded, and the progress of the two 
groups compared. The difference in progress of the two groups 
will approximate the difference in efficiency of the two methods. 
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The degree of accuracy of the results will depend 

care with which the tests are given and the degree to w 
conditions of the drill work are equalized. It is an open 
whether or not the teachers themselves should be infor 
the main purpose in view—that is, the purpose of compari 
efficiency of the two methods. If we could be perfectly 

both teachers would be thoroughly interested and honest 
the experiment it would undoubtedly be wise to seek their in: 
gent cooperation, since by so doing we should be more | 
get the best possible results from both methods. But if, thi 
that their reputations are at stake, one or both are likely 
tempted to stretch the time limit for daily drill or to per 
the pupils to drill themselves for speed and accuracy out 
lass, then it will probably be better to leave them in 
ignorance of the main plot, merely seeing to it that each t 
devotes the same amount of time to class drill in the fundan 
tals each day. In this way one can infer what each of the met! 
would accomplish under everyday working conditions 
hands of equally competent teachers. If one is particula: 
irous of getting the best results of which either method is « 


this purpose may perhaps be accomplished by asking each teac! 


separately to do her very best. 

This particular problem was worked out in my district 
year with rather interesting and fairly conclusive results 
Courtis Standard Practice Tests were not in use in the 
but, wishing to introduce them the following September, I p! 
ahead to have the stage set for their appearance. That is, | 
the practice tests were introduced generally, I wanted if | 
to prove definitely that better results could be accomplish: 
their use with less drudgery for both teachers and pupils. 

This was before the teachers’ ratings had been computed s 


did not have their ratings for guides in selecting the teachers t 


carry out the experiment. But I did have the records of progres 


for each school as shown by the September and February test 


Wishing to secure as accurate results as possible under the ci 


stances, I tried the experiment in each of three different towns 


lo handle the work with the practice tests three teachers w 
selected (one in each town) who had shown interest and capa 
in adapting new ideas to classroom use and whose schools 


made normal progress during the first half of the year. [1 


ve 
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the end of the winter term these three teachers 
vith the Courtis Standard Practice Tests ( 
ind Students’ Practice Pads | s} wed then how 
ests. pointed out their advantages, and explained 
es underlying them. Then I told them that for 


of whi h they would be informed in due tin e. 


to have them become as expert as possible in using 


the end of that term Thev assured me that they 
‘ best ind 1 believe they aid \t te they 
wel 

r three teachers. one in each town, were chosen be 
hools had also shown about nor ogress for the 
‘ ea ind because ol the irther ! t t the ere 
ing kindly to new ideas, but withal hardworking, 
and capable of doing very good work in their own 


} 


other words, they were good ol 
j AX ~ 


} 


lligence tests had been given by this time throughou 


and I hastened to get the mental ages and intelligence 


of all the pupils for use in selecting the several groups 
re nally selected according to the pian outlined avove 
tne ides In any one scnool were loo il tO alloV 
of ten pupils being seiec ted from the same grade in 
that the six groups would all average the same 1n 
ages and | However, the conditions regard 


} 
T 


\.’s anc I. were strictly observed and allowed io1 


( 
nths 


st mental age in any group was 10 years 


ighest was 11 years, 5 months. The I.Q.’s ranged from 


the Woody scales for measuring the ability of pupils in 
lamental operations, I gave the first tests to the six picked 
luring the first week of the spring term, and corrected ar 

n myself, tabulating the average scores for each group 
subject as shown in Table I, in the columns marked 


\t the time I gave the tests to eat h group Ol pu] ils. [hada 


heir teacher telling her that for very in ortant reasons 
er to see how much improvement she could bring about 
particular group during the ensuing twelve weeks by 


the pupils together just tifteen minutes each d iy lor spec¢ d 
accuracy in the fundamental operations ol arithmetic. The 
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TABLE I. AVERAGE SCORES IN THE WOODY SCALF<s 
(a) Groups not Using Practice Tests 


Group |! Group 2 Group 3 
OPERATION — —— 
\ B A B \ B 
Addition 11.6 | 14.8 | 12.0 | 14.7 | 11.8 | 11 
Subtraction 8.2 10.6 8.4 10.3 7.9 10 § 
Multiplication 85/122) 83/120] 81/124 
Division 8.5 5.9 8.0 6.1 8 - 
Mixed fundamentals 21.0 | 25.9 | 21.0 | 26.1 | 22.2 | 27.0 


(b) Groups Using Practice Tests 


Group 4 Group 5 Group 6 Ay 
OPERATION 
4 | B A B \ B \ 
| Addition 11.9} 16.0] 11.7/ 15.8 | 11.7] 16.3) 11 
Subtraction 8.1} 12.4 8.6} 12.2 80} 11.9 R 7 
Multiplication 8.0 | 15.3 9.0) 15.5 14.8 8 4 
Division 5.4 96 5.7 | 10.2 5.8 9 3 5 
Mixed fundamentals 200! 19.5 30.0} 23.0| 206) 21 


three teachers trained for the purpose were directed to us« 
the Courtis Standard Practice Tests for the drill, but to use ther 
for all they were worth. None of the teachers had any inkling 
the real object in view. Yet each one was keyed up to do her 
best after her own fashion. Every pupil in the six groups \ 
promised a special holiday for not missing more than on 
during the term. Pedagogically, of course, this may have been 
questionable, but psychologically it proved very effective; and 
I hoped that the end would justify the means. At any rate, | 
know that a large majority of the pupils got their holiday. 

The work was supervised as closely as possible throughout th 
term. Neither from observation nor by questioning pupils co 
I detect any evidence that the rules of the game were being dis 
regarded by any of the teachers. At the end of twelve weeks th: 
pupils were again tested with the Woody scales. The averag 
scores for each group were placed in the “B” columns of Tabi 
I in such a way that each group’s second score in each subj: 
was Opposite its first score in the same subject. According to th 
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the average score of the pupils of Group 1 on the first test 
Column A) was 11.6. The score for the same group 

ond addition test was 14.8 as shown in the first “B”’ 
[he scores for the three groups which did not use the 
were averaged for both first and second tests; and 
orded in the fourth “A” and ““B”’ columns, while in like 

e general averages for the three groups which used the 

ts are recorded in the last two columns of the table. 

be noted that, according to the ‘“‘A’”’ columns of the 

iverages, the two main groups, the first consisting of the 
ller groups in which the practice tests were not used, 
he second, of the three groups in which they were used, 
most exactly even in the race as might be expected under 
ymstances. The first score of both groups in addition 
11.8 and the first score in subtraction for each group was 
[he remaining first scores differed by but one or two tenths 
But this correspondence is no longer apparent when the 
columns of general averages are considered. The final scores 
he group using the practice tests are seen to be considerably 
r than those of the group not using them. The differences 
n the scores contained in the fourth and last ““B’’ columns 
represent the difference in progress of the two main groups. 

[he group of pupils drilled with the practice tests has all the 
f the argument, the difference in progress being sufficiently 
to prove conclusively considerable superiority for the 

Courtis method properly handled. On the whole, the improve- 

ent of all the groups was surprisingly large for a period of only 
ve weeks. It amounted on the average to about a year of 

ss for the groups which did not use the practice tests and 
to about a year and three-quarters for the group using the prac- 

tests. This merely goes to show what can be accomplished 
y intensive work along definite lines when the interest of teach- 
ers and pupils has been thoroughly aroused. 

Now to return to the second way in which we might want to 

pare special methods. Suppose we wish to learn which of 

two or three special methods will give the best results with a 

particular teacher. This is quite a different matter from measur- 

ng the relative efficiency of the methods themselves. Only in 
exceptional cases can methods be accurately compared when 
handled by the same teacher. For such a purpose the teacher 
must be equally skilled in the use of the methods to be compared 
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1 without prejudice in lavor of any partici 
7 
es d dis ivantages of ear meti a 
let? nd ] } 
itte id Make the most ol ne 


excepuionally well-trained and widely experienc 
the impartial mind of a scientist seeking truth t]} 

nt, can tulnll these conditions. Such tea het 
fo lin everv school svstem. 


We know that quite often a method of teachiy 
roved highly successful when handled by its 
rs specially trained by him, has failed 
introduced into an alien school system where t 
trains | and experienced in other m¢ thods An 
e wondered at. When the mere form 
vithout its spirit, is introduced among wor ers la 
edge of the proper technic to accon pany the met 
rally prejudiced in favor of their own methods. the n: 
loredoomed to failure. A few of the better teacher 
endowed with adaptability and initiative. n ay 
tages of the new method, gradually evolve 
nic to fit it, and adopt it as their own. But most t. 
themselves accomplishing less with the new met 
did with the old, and longing for the familiar routin: 
constant supervision prevents, return surreptitiousl 
their former procedure, convinced that there is non 
that attempting new methods is a waste of time and tr 
nervs 
Ot course if the rea] interest of the teachers can be 
the new method by a judicious advertising campaign bi 
introduced, and if everybody’s patience holds out lo r 
and a definite policy of teacher selecting and teacher \ I 
is carried on, eventually the new method will come int 
if it really possesses marked advantages But in t LO 
instances the innovation is discarded as worthless 
months of half-hearted trial without any adequate atte: 
heen made to modify the environment to fit the 
\nd the chief factors contributing to such failures i: 


to introduce new methods of teaching into a school sysi 


the indifference of teachers or their actual antagonis1 
new methods, in general, their lack of knowledge concerning two | 
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ew methods, and their lack of foresight and initiative 
themselves and their ideas to changing conditions 
most annoying factor and the one most difficult 
the teacher’s mental attitude toward new ways of 
her clinging to familiar trails, and her aversion to 
y paths even in the interest of finding a smoother, 
pleasanter road to her goal. 
y methods, unless real interest and belief in them 
roused in the teacher beforehand, have to contend 
norance and indifference or prejudice from the start. | 
herefore, that the efficiency of new methods cannot be 
compared with that of old methods if the new ones 
by the very teacher whose own methods are being 
is to their comparative worth. Her attitude is too 
that of the hen defending her chickens from the hawk 
destroy them, the teacher’s chickens being her own 
ethods while the hawk is the superintendent with his 
r new ideas. 
We can, however, determine pretty accurately which of two 
: teacher can (or will) handle most efficiently regardless 
tual possibilities inherent in the two methods. And 
ssential that each teacher use, in general, the methods 
she can produce the best results, it is also essential 
know what those methods are. It will not be found 


merely for the sake of having certain new methods, to 


their continued use on teachers who cannot or will not 
is good results with them as they produce with their 
iods. So we must have some way of determining whether 
achers are doing as well or better with the new methods 
sing them a reasonable length of time, say six months or a 


[his can be done with the help of standardized tests. First 
ten or a dozen pupils in the school with mental ages and 

[.Q.’s as nearly equal as it is possible to arrange. Divide them 
two equal groups that average about the same in mental 
Next test them with some standardized tests in the 

for which special methods are to be compared. Then 
teacher try out two methods, one on each group of 

ils, over a period of three or four months. At the end of 
time give the tests again and compare the progress of the 


two groups. 
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Such a trial will not necessarily prove which method is +h. 
better as regards possibilities, nor with which method the teaches. l. 
could do better if she had the proper inclination and trainin 
it will prove with which method she will do better under , i 
ing conditions. And that is the essential point. If. afte 
preparing carefully for the introduction of a new method oj v 
teaching some subject, by discussing its possibilities with teacher: 
individually and collectively, and by furnishing them with syj: 
able reading material concerning its basic principles, special 
vantages, and technic; if after demonstrating to the teachers + 
proper handling of the method and giving them a reasonab| 
length of time to acquire skill in its use; and if after striving ip ¥ 
every way to arouse their interest and hearty cooperation in 
ing the new method a thorough tryout; if after doing al 
things and as many more as you can think of, you make such a —- 
comparison as outlined above and find that a teacher either can- 
not or will not do at least as good work with the new method ' 
she did with the old, then it is time to discard either the teacher the 
or the method. If your best teachers have succeeded in getting 
superior results by using the new method, it means that 
method is all right and it may be wise to keep the method 
get a new teacher. But if your best teachers have { 
better results with the new method after several months of earnest 
effort, it will probably be better to discard the method 

At any rate, in order that the children may get the most for 
their time and the taxpayers the most for their money, it be! 
us to make sure that the methods in use in the schools under 
direction are the most efficient that can be used under existing oad 
circumstances. We can do this either by selecting and training = 
teachers to fit our chosen methods or by selecting methods 
fit the available teachers. Most emphatically it is not efficiency 
to cling to new methods forced upon untrained or improper! 
trained and often unwilling teachers just because they are up-ti . 
date methods, when those teachers are not doing as good work ‘om 
with them as with their own methods. Unless we can train ou ry 
teachers successfully in the proper use of the new methods xin 
obtain teachers already trained in their use, we had better stich “4 


alled to t 


TOVE 


to the old a little longer. Standardized tests will help to pr 
whether or not the new methods are more successful than the 
old methods in a particular environment. Results are more 
important than methods. 


| 
| 


“NRELIABILITY OF INDIVIDUAL SCORES IN MENTAL 
MEASUREMENTS 


Joun L. STENQUIST 
f Reference, Research, and Statistics, New York City Public Schools 


uf 


With the rapid adoption of tests, including both measurements 
telligence and of educational achievement for purposes of 
ter classification of pupils, a fundamental fallacy has in a large 
r of cases crept into the statistical procedure, the fallacy, 
of neglecting to take account of the variability of 

il scores. 
Many users of tests have innocently passed from the former 
rations of grade or school averages to the consideration of 
} tus of individual pupils without making provision for the 
unreliability of a single measurement. Undoubtedly the status 
he individual pupil is precisely what must be emphasized by 
54 idministrators in order to obtain any great benefit from 
the use of the tests. But caution must be exercised in taking 
step lest we fall into serious blunders and reach unsound 

lusions 
AVERAGE VS. INDIVIDUAL SCORES 
When dealing with measurements of a group—say a class with 
n ordinary test of intelligence—we customarily compute the 
iss average. The reliability of this average will generally be 
ciently high for all practical purposes. On the basis of it we 
re justified in inferring that Class A is brighter in general than 
Class B, that it is less bright than Class C, etc. If a second form 
{ the same test is given, the average derived from it will not 
differ greatly from the average for the first form. Such class 
scores are fairly reliable because they are based upon a com- 
paratively large number of measurements. In any such group 
measurement we really have as many samples of that group as 
there are individuals. The unreliability of each score is, for the 
most part, due to chance errors; and these discount each other in 
the long run and can, therefore, be neglected so far as the group is 
concerned. 

When, however, we turn from the consideration of the score 
‘or the group to the consideration of the score of any individual 
pupil in the group, as determined by a single test, the trust- 
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worthiness of our score is entirely changed. In a seco; 
the same test, the score of a given pupil will not n 
closely similar to his score in the first form. This is du 
lack of sufficient sampling of his ability. Many factors 
change his score; thus he may be physically less fit 
test than during the other; he may be emotionally dist 
time and not at another: the precise tasks required 
forms of the same test may for accidental reasons be 
dfficulty for him, even though they are identical, as 
up averages Hence we have the net effect of vari 
in average performance. This phenomenon is pro! 
known as any other in the whole field of mental m« 

it is a common pra tice totally to disregard it. In 
classify individual pupils by test results, as is now beir 
many cities, radical cl nges in grading are frem 
mended, entirely neglecting the unreliability due to 
sampling of each pupil’s ability. 


THE AMOUNT OF VARIATION IN SUCCESSIVE TEs1 
The actual variations which may and do occur in 
score in successive tests of the same trait are a serio: 
when we attempt to place him in a specilic grade accordi 
one Ot such scores lo show concretely what happ¢ ns 
for a sample class taken at random out of some sixty 
public school 64, Manhattan, is cited in Tal 
tests were given under closely parallel conditions 
period of about four weeks. They were all administer 
same teacher, who was one of the most skillful of forty or 
gave tests. All scoring was carefully verified by a recheck o1 
pupil. An examination of Table I shows the mental age as ceter- 
mined by each test, and the average age according to all t 
(Column 12). The average age is the most significant as it 
sents five distinct trials on the part of each pupil. Using 
the true mental age, the extent to which each pupil 
from it in five trials is shown in columns 3, 5, 7, 9, and 11 
lable I reads: Pupil No. 1 obtained a mental age of 166 months 
National Intelligence Test, Scale A. This was two months less tl 
veraging his results on all the tests he took; his mental 
to the National Intelligence Test, Scale B, was in excess of 180 mont! 


twelve months more than his mental age as obtained by averaging his r 


the tests he took; etc 
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LTS IN FIVE INTELLIGENCE TESTS GIVEN BY THE ONE 
CLASS 


EXAMINER TO ONI 


Average 


9.2)164.8| 7 


: 

~ > = > 

2/180+/+12) 22/162 6 1681 106 

1/18 182/4+ 6/180 41162 141 176] 58 

9/1804 9} 158|—13/178 |+ 7/159 12 171) 10 

10\162 162) + 11170 |+ 8| 162] 38 

16 4) 16 + 8/162 3} 165) 5 

150 9/164 2} 165) 62 
118 0180 | 180} 10 
134 10/159 15} 15 6/132 12146 |4+ 2| 144) 90 

15] 16 11174 81175 166 

155 8/143 20! 170;+ |+18]/174 |4+11] 163] 128 

$131150 |+ 7) 13 127 143} 10.2 
140 17)182 153 155 2} 157] 122 
ter L 42 155 |+ 41172 |4+21) 151] 136 
147. |+17| 123|— 7/125 $1126 4) 130) 82 

159 01169 |4+10, 15 71172 17; 159) 94 
160 16 170 |+ 4/157 9} 166) 72 
138 25/180-+/+17) 176/+13)174 |4+11/134 163) 190 

159 177. |+10/179 |+12] 167] 106 
180 1/180 206, +22/180 $175 184 86 
150 61160 |+ 4 141 15172 |+16) 156) 82 
181. |+ 4) 178/+ 1/175 21172 30 

180+!+13| 167) 0/161 6/160 7| 167) 65 
174 183 |+ 6 180/+ 31180 |+ 3/166 11/ 177] 5.2 
170 31180+1+ 3 182 |+ 91180 |+ 7| 173] 65 

126 301185 |+20) 154/— 21157 |+ |+ 1] 156] 85 
139 131161 |+ 9] 144/— 8/152 |412) 152) 84 
140 |—16/157 |+ 1) 186/+30)162 |+ 6/137 19} 156) 14.8 

142 146 —14]157 31176 |+16| 160) 142 
147 12,180+/+21| 141/—18)173 |+14)151 8} 159) 138 

139 |—25)180+/+16) 182/+18/167 |+ 3/154 164) 144 

165 ? 180+/)+ 6/180+/+ ¢ 174 57 

180 5)180+/+ 5 175 166 9| 175) 47 

147 61160 132/— 9/124 17/143 |+ 2) 141) 106 

1686 | 2931/5462 | 345) 4498! 258) 5110) 217) 5298) 315) 5367|2959 

156. 2/9. 76) 6 |162 6) 9.0 
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FiIvE PARALLEL TESTS OF GENERAL INTELLIGENC) 


While other tests which are often utilized as int 
measures were given, they are not here included becaus: 
lower correlations with our criterion. This criterion i: 
posite (equally weighted) score in the following six tests 


Che coefficients of correlation for each of the tests in Table |} 


1. The National Intelligence Test, Scale A 
The National Intelligence Test, Scale B 
The Haggerty Intelligence Test, Delta 
The Otis Intelligence Scale, Advanced 
Meyers Mental Measure. 

». Kelley-Trabue Language. 


Ww 


~ 


this criterion are: 


National A r =0.801 (n=560 
National B r =0.788 (n=518) 
Otis (Advanced) r=0.680 (n=551 
Haggerty, Delta 2 r=0.808 (nm = 532 
Visual Vocabulary r=0.680 (n = 461) 


In addition to our records in the tests given in Table I 
have records in the Kelley-Trabue Language tests, in the W: 
McCall Arithmetic, and in Meyers Mental Measure 


however, correlate with a coefficient of only 0.58 (m=581 
and 0.48 (m=544) respectively, with our crit 


= 298), 


National A, and B, and Haggerty are very similar in nat 
the Otis test does not differ greatly. Thorndike’s Visual \: 
lary Test while purely a test of word knowledge, corr 
exactly the same as the more elaborate Otis test. The s) 
self-correlations do not appreciably operate to the disadvant 


of any one test. 


EQUATING NORMS 


In turning raw scores into mental ages (to secure a comn 
unit) as has here been done, the question of the comparabilit: 
norms as furnished by the authors of the tests is involved 
were equated for all but the Visual Vocabulary Test! as t 
Twenty-seven classes including 1,007 pupils were measured 
all of the tests; utilizing the pubiished norms every raw 


' The norms for this test were established with great care and careful 
procedure by Mr. R. H. Franzen, Director of Educational Research, Des M 
Iowa, on the basis of some ten thousand cases in New York City and vicinity 


| | 

i 

| 

| 

| 

| 

| 
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turned into a mental age. These twenty-seven classes 
six eighth-grade, seven seventh-grade, ten sixth-grade, 
fth-grade classes. 
ring these twenty-seven classes as a unit, each test 
it measures the same thing as the others (as it does 
itely), and if the norms are comparable, give the same 
- to this unit of 1,007 cases. This we did not find to 
Comparing the average age according to each of 
ith the average age according to the Haggerty Delta 2, 
at the average age according to the National A was 
higher, and that the corresponding figure for National 
months higher, for the Otis 3.7 months higher, and for 
\lental Measure 6.4 months lower. 
blished norms in current usage at the time of our testing 
ount of deviation from Haggerty’s Norms (which were 
, point of reference, because of the large number of cases 
vide geographical distribution) are given in Table II. 
we say that the norms for the National Intelligence 
e A, were thirteen months higher, we mean that the 


TABLE Il PUBLISHED NORMS USED 


Deviation of 

Norms from 
Test 6 7) 8 910) 11) 12) 13) 14) 15 Haggerty 
Delta 2 


\ \74|79)89) 102) 113/123) 134 13 months higher 
76/81/89) 102)112}124)128 7.5 months higher 
Delta 2 | | |25/43/55] 77| 87|100/115 
40/52/64) 76) 88/100 3.7 months higher 
| 
M Mental Measure 43| 47| 49) 49164 months lower 


score corresponding to each mental age, as given in the 

ae manual accompanying the test, was apparently too high, and that 
the average it represented the children as being thirteen 

months younger mentally than they are represented to be by our 

evision. Accordingly, we lowered the norms for this test, by this 
int thus making them less severe. In effect, this means that 


\GE 
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for each child when tested by the National Intelli 


Scale A, we added thirteen months to the mental ac 
Cen | 1} ed according to the autl ors I 
were ic] ed to the ages of clhidren f 
Intelligence Test, Scale B. and four months for 
In Table I these adjustments have been made 


ANALYSIS OF VARIATION IN Five TESTS BY THE Say 


With these facts in mind we may examine mor 


scores of each pupil in Table I 


mn 13 shows t iveravge devi ion In mo 
OT pur li Clive pu out ot 
ce evi ( the ave tne ve tl 
' or more, which for practical purposes is about equ 
' vear. If we examine individual cases we find stil] 
evi ence Oo! how irious a procedure is to 
precisely by a single test. Note Pupil No. 12, for 


his score in N; tional \, had been our sole | is he 


been « ined as forty-two months younger met 

. shown to be by National B, and seventeen mont] 
the verage five tests Again, not Pup No. 2s 

tions in months of mental age are in order: 18 
and +16. It will make an enormous difference t 
whether he is classitied by National A or by Natl 
difference in his mental age by these two tests 
eight months, or over three years! Almost the sai 

! pupils 17, 27, 29 and 30. Six extreme cases are al 
shown in Figure 1 Here it is apparent at a gl 
variation is very great. A pupil by any one test n 

. misplaced by two years 

| THe EXTREME CASES 

. The cases selected for Figure 1 are, to be sure, t) 

: treme ones. It is true that most of the cases deviate ‘ 

average of the average deviations for the class is 8.7 1 

when we propose ret lassilication of pu] ils, we proposé 

! of them. \ll are tested, all are placed. But if as 


third of them may be approximately a year older o1 
mentally than a single test result shows; and if a f 
have at least six out of thirty-five or some 15 to 20 perce: 
every class may be misplaced as much as three or more y: 


our work is too unreliable to be utilized for classification | 
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and may be no improvement over ordinary teacher-judgmen: 
methods. We believe that variability as great as that w 
shown is not unusual. Those who doubt this should pr 
checks upon their results as we have done and first demo 
that the great variability that we have found is the except 
is here maintained that it is the rule; and that unless in 
tests to diagnose individuals, measures are taken to over 
the present testing movement will fall into disrepute, becaysy 
tests misapplied cannot do what is claimed for them by ent! 
siasts 

In connection with this failure of successive test r 
agree, we might appropriately raise the question: “Whi 
shall we accept as most significant?’”?” We commonly ass 
the average is nearest the truth. However, as Thorndi 
pointed out on several occasions, in nearly all physical fi 
take not the average performance but the maximum. W: 
interested, for instance, in the average height which a pole vaulter 
can clear, but the maximum height. Similarly it woul 
unreasonable to use the maximum performance in menta 
However, this is beside the main issue, namely, the variati 
score from test to test. 


THE REMEDY 

The remedy is clear, and simple, though to be sure it is not on 
to elicit great enthusiasm. What is needed is a more thorough 
testing of each individual pupil—more tests, with equated norms 
utilizing of course more and more reliable ones as they bx 
available, and a more and more precise technic. When 
results for an individual pupil are even approximately as reliabl 
as our averages for classes then they will withstand any criticisn 
and will be trustworthy. But this means more labor, more expert 
direction, more test material, and greater cost. 

The very least that may be done is to supplement the single 
thirty-minute intelligence test, now so popular, by at least one 
other—better still by two or three—before extravagant reports 
are made concerning the mental status of individual pupils. To 
repeat: In the past when our inferences were confined to averages 
we escaped these invalid conclusions. Now that we propose t 
speak of the individual, we must not overlook the statistical 
implications of the step that has been taken, but provide a techni 
that will make possible what we are attempting. 


| SQN 
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oa ‘HE EFFECT OF KINAESTHETIC FACTORS IN THE 
Pi DEVELOPMENT OF WORD RECOGNITION IN 
THE CASE OF NON-READERS'! 


GRACE M. FERNALD AND HELEN KELLER 


University of California, Southern Branch 


[he cases reported in this paper are all those of children of normal 
Ase mentality who have failed to learn to read after three or more 
in the public schools. In all cases but one the vision was 
The method described here was used only after the child 
been given several weeks of individual instruction by recog- 

| methods and had failed to make any improvement. 

Many children who have been brought to us as non-readers 
with individual instruction and proper motivation, learned to 
read quite easily by ordinary methods when they were given 

lual instruction and proper motivation; others proved to be 

y deficient. In five years we have found only seven cases 

al non-readers, even though children have been brought to 

m all parts of the state. In all seven cases the presumption 

f mental deficiency had been made as the explanation of the 

reading failure. In all but one case, however, the intelligence 
juotient was found to be at least 100 by the Stanford Revision. 


METHOD 
gn 1. Learning first words——The child was asked to tell some 
n word he would like to learn. The word was written in large script 
on the blackboard or with crayola on cardboard. The child looked 
at the word, saying it over to himself and tracing it if he wished 
todo so. The tracing was done with the first two fingers of the 
right hand (or of the left hand if the child was left-handed) resting 


ert on the copy. It was never done in the air or with pencil. When the 
child was sure he knew the word, the copy was erased and he 
ss attempted to write the word, saying the syllables to himself as he 


wrote them. If he was unable to write the word correctly, the 
entire process was repeated until the word could be written with- 
Ae out the copy. At no stage of the performance was he allowed to 
7 copy the word. After a few words had been learned in this way, 

' This paper is to be followed shortly by two others, giving the results of experi- 


ments with first grade children and of experiments in spelling. The bibliography will 
. be published with the final paper. 
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he was shown the word in print as well as in script 
day he was shown the word in print only. If he failed 1 
nize it, it was written for him. If he still failed to reco; 
it was retaught as on the first presentation. 

2. Spontaneous sentences.—After the first few days t 
began to ask for sentences instead of words. A sentenc 
written and he learned the words comprising it, finally 
the entire sentence as many times as he wished—alwa 
memory, never from copy. 

The sentences the child had requested were then 
cardboard or were typewritten. These sentences a 
made of the same words, were read by the child. Thx 


pn 


words were repeated in different sentences from day to da) 

3. Words in context or story selected by the child.—As 
the child was able to make out simple sentences, he was 
the library and allowed to select a book. The first par 
read were worked over in the following manner. Bei 
reading, each word which had not already been learned 
posed through an adjustable slit in a piece of cardboard. Ii 1 
child failed to read the word it was pronounced for him. He | 
nounced and then wrote the word (as before without lookir 
the copy If he had difficulty in writing the word after 
it in print, it was written for him and taught from the scri 
in the case of the first words. 

4. Apperception of phrases——After the words in the 
paragraph had been taken up in this manner, brief exposur 
the words were given until the child was sure of them. W 
recognition was immediate for every word, the slit was ad) 
to phrases, and flash exposures of the various phrases were gi 
The exposures were never long enough to permit the phras 


be read word by word. As many successive exposures as wer 


necessary for recognition were given. After the entire paragra} 
had been worked over in this way, the child was told to read t 
paragraph to himself and report what he had read. 

5. Silent reading for content.—As soon as possible the c! 
was encouraged to read to himself. There was no difficult) 


any of our cases in getting him to do this after his progress had 


gone into the fourth phase as described above. 


| 
| 


DESCRIPTION OF CASES 


¥ 
es have been successfully treated to date Four 


lescribed in the following pages. In one case, in- 
the above statement, the work is incon plete at the 
e but the results showed normal progress during the 

erimentation. Two additional cases, one Irom New 
ne from Colorado, now under investigation, have both 
e third stage. In the latter of these two cases the 
vy able to learn new words rapidly from print and to 
correctly although he was unable to read or write his 
wo months ago. 


CASE I. BOY (LESTER 
December, 1916) 10-2; mental age (Binet Simon, 1911 Scale 
ber, 1920; age, 14-2; mental age Stanford Revision 
14. Vision, normal. 
»y —Lester had been in the public schools of Los Ar reles for 


ling one year in the kindergarte! When igl ir 
; 1 been in the second grade ol the Normal Training School for 
ving been entered in the Training + hool as a last resort after 
he city schools. On account ol his size. he was first placed 
le: but. as he was unable to distinguish one-s) llable sight words 
0 into the first grade Here a special effort vas made to te } 
a small group where special instruction was p ssible. Since 


progress whatever, he was reported to the psychology depart 


entally deficient. 
e results of the mental test did not show sufficient retardation to 


his complete inability to read, we kept the boy under observat 
ne The case came to our notice at a time when we were pa! 


saged with poor spellers. Accordingly, we put Lester intoa group of 
nellers, where individual work was being done 

} —The work in the spelling class referred to was being conducted 

ving manner: The children watched while the word was written 

kboard or on cardboard. They said the word over to themselves, 


with their fingers if they wished to do so. The tracing was done 
e first two fingers of the right (or left hand in contact wit! 

n the air or with pencil did not seem to produce the same results as 

¢ with the fingers. When each child was sure of the word, it was 

+ otherwise removed from view, and the ¢ hild wrote the word, saying 

les to himself as he wrote them. He was allowed to write the 

‘s manv times as he wished. provided he did not copy It Irom a prev! 1s 

g Except for this special work in spelling. the method was the same 


lescribed on page 355 


lis —Lester developed a craze for writing words. He would 
rk at it by the hour, tracing words over andover again. To our surprise, 
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after the first week, he seemed to be able to write from me: 
which he had written previously several days in succession 

We had the same words which he had learned to writs 
each time the boy wrote a word in script we showed him the 
printed form. Recognition was developed almost immediat: 
words he had written. At first he learned only two or three 
then several a day. After about two months, he was able to lo 
in print, say it over to himself, and write it correctly. This was tr 
words of three and four syllables. At this stage of his devel 
he had once written a word, he would almost invariably re 
successive presentations. Yet, on the other hand, if told a w 
over again on successive days, he failed to recognize it unless h« 

Since the boy was interested in history, and especially in the 
a history of the United States as our first book. The met! 
is described in the introductory statement on method. 

Unfortunately we had no idea of the significance of the w 
no records of the exact words written from day to day, as we d 
cases. Much of the writing was done on the blackboard and in 
erased 

The boy seemed suddenly to go ahead by jumps. At the er 
months he was reading so readily that we had a demonstration bh« 
various first- and second-grade teachers. They refused to believe t 
actually reading until they brought books selected by themselv: 
him out with both oral and silent reading. 

After six months in the University Training School, the far 
and the boy went back to the regular city schools. 

December 15, 1920, just four years after our first experience wit 
we found him doing satisfactory work in the seventh grade of the 
His teacher was surprised when we asked about his reading, and sa 
an inveterate reader. 


TABLE I. RESULTS OF READING TESTS 


Date Test Results 


Dec. 1916)Several |Zero on all tests; could not read or write words like ‘“‘cat 


Dex 1920/Kansas Lester’s Results Standard Ability S 


|Silent, |Rate |Comprehension|Rate |Comprehension|/Rate Com 


\Formll, 106 24.7 1106 (7th Grade, 23 8th |Abov 

iTest 2 | (For [Sth Grade, 26.4/Grade| Gr 
Eighth | 

} srade) | 


Note: Lester had never seen any of the upper grade Kansas Silent Reading Tests 
was given December 1920. 


Summary of case. At the age of ten years, after over four years 


elementary grades of the public schools, Lester was totally unable to 


| 


Ail 
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he developed from a zero score in reading ability to ready word 
For the last three and a half years, without further special 


levelopment in both silent and oral reading has been per- 
During this period he has advanced from the first to the 


CASE II. BOY (HENRY 
8: Mental Age (Stanford Revision), 12-8; I. Q., 131. Vision, 


tory.—Henry entered the kindergarten of the University 
when five years old, and has attended the same school 


», except for part of one year lost on account of measles 


{ unable to learn to read or spell although he had been given 
ruction, including drill in phonics. He was referred to the 
epartment as a possible mental defective. Although the 
e mental tests indicated unusual ability, he was found to be below 
g rating in the Kansas Silent Reading Test andin the Ayres 
He also failed completely in all tests for phonics. 
Che method was the same as that previously described, except 
i not tend to trace the words. He would look at a word which 
for him, say it over slowly, have the copy removed, and then 


g each syllable as he wrote it. He soon developed considerable 


g words in this way; but he was very slow at first in making 
between the word he had written and the printed word. 
ng it was necessary to present each word daily for five or six 

e association with the printed word was formed. 

s so little progress for the first few weeks that the psychology 
was consulted repeatedly with reference to the seeming failure of 
evelop word recognition. His mother came often to observe and 
rself as convinced that it was simply another failure. She felt 
tried everything. Besides being in a small class with a particu- 

| teacher, he had received special help at home and special work 

th the reading department. Every effort had been made to 
ge the boy; he had even been promoted to the fourth grade in order 
effect of encouragement. As he could do nothing with fourth- 
ng and spelling he went back into the special study room. It 
ficulty that we obtained the mother’s consent to have the boy 
ntally. She has since told us that she was afraid he would be 
tally deficient. When informed of the results of the test, she was 
keptical. It should be stated, however, that she was very careful 
the boy know of her discouragement and that she cooperated with 
ghout the experiment. 
r the fifth week Henry suddenly began to make such rapid progress 
lmost impossible to keep track of him. He could write any word 
igle presentation and after he had once written it, he would recog- 
either script or print on subsequent presentation. As one of the 


all 


t teachers expressed it, he was “on.” Five weeks after our first work 


} 
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vith him, he wrote the wor 5 (serland after o e present 
t \rint ( ter 
Henr rst re 1 the reader I 
rite \ l to | ive | he 
equi prese s. The eloy 
we vid, however. afte the 
himself, asking anyone to pronounce a word 
‘ i slip of paper 
= 
I I e woen Henry began working alone 
expe t, he was worki gy out n new wW ds 
: pr ed r hin rw it needing to rite ther | 
ed structio 1 ph since the experiment eg 
t that t e to have no knowledge of the a ‘est give M 
showed the beginning of the development of the recog 
units 
Work was begun in February and discontinued ] 
the school year rhe mother reported that the oy re 
able dur g the summer—librarv books, newspapers 1d 
On his return to school he went into the regular fifth gr 
r g \I rch. 1921 he is do g satis \ 
I I te tS given 1n November showed hi a 
lO d fifth grade iccording to both the S ircl , kK 
: ibove tl of the sixth grade accord ng to the Gray Oral | 


obtained from tests of spelling, reading, and phonetics. O 
Scale. His rating was ten percent, and the 
performance may be judged from the fact that the se 


1920, Henry was given a selection of words from Column | 

: e following are the 


for these words is fif y percent I 
actually wrote them, the words in parentheses being the corr 


1. I (cate) 8. gon (gone 15 


2. lake lack 9. se t It 

: 3 rme (warm 10. trak (track 17 

' 4. inles (unless 11. w (watch 18 
5. Cot! ng r thing 12. daas (dash 19 
6. be egan 13. fell (fell 20. 1 


On April 25, 1920, another selection of words was give 
of the Ayres scale. This time Henry’s record was ninety-five | { 


compared favorably with the standard for the fifth grade 


On February 6, 1920, and again on November 22, 1920. | ; 
tested with the Kansas Silent Reading Test, Form I, Test I, v 
ing results. In the first test his rate score was 36 and his c 
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The lowest grade for which standards on the Kansas Silent 


re available is the third grade. For this grade the standard 
comprehension, 7.2. Thus, Henry’s pe e was 

w that which one would expect of a typical third-grade 


nd application of the test (November, 1920) Henry’s 
03 and his comprehension score was 18. This compare 


the fifth-grade standard of 89 for rate and 19 for compre 


er 22, 1920, Henry took the Starch reading test for the thi 


grades. His scores in comparison with the standards for 
grades follow 
HENRY'S SCORE STANDARD 
Speed Compreher Speed ( r 
sion 
23 33 21 
3.2 31 24 24 
26 21 28 33 


Although every effort has been made to teach Henry 
e second and third grades the results of all phx nics tests 
were entirely negative. He had no idea of the sound signit 
binations. 
ving results were obtained in tests given by the reading 


No instruction in phonics had been given since the experiment 


Test Grven May 17th, 1920 


t 
hash, mash, crash, flash, nash 9 am—fan, sam, fan 


bin, lin, tin, men 10. ite 
he 11. all—fall, ball, mall, hall, tall, dall 


12. inch—pinch 
nd, find, dind 13. ale—pale, fal le, male, tale 
14. age-—pag ge, mag 
end, senll, mend 15. ad—sad, mad, lad 


mose 


Test DeceMBER 24th, 1920 


rack, tack, mack 9 and—hand, sand, cand 
d ll, tall, call, mall 10. ang—rand, dang, sang 


mate, fate, late 11. emk—sank, bank, flank, tank 
+ eni—rent, ment, sent, tent 12. ark—mark, hark, lark 
ting, bing 13. atch—catch, match, atach 


cow, row 14. e reck, heck 
r r, lair, rain 15. end—attend, blend, afend 


#—mail, lail, fail, rail 16. ure—sure, picture 


N ven b 
l 
isc, 
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Summary of spelling and reading tests.—(a) Spelling: Progress f; 


second grade to fifth-grade standing in three months. (b) Re 
ress from much less than third-grade record to fifth-grade ir 
(c) Phonics: Although no instruction had been given in p} 
January and May, and although Henry seemed to have r 
phonics at the earlier date, tests given at the later date showed : 
ment of associations between many letter combinations a 
values. Tests given in December of the same year showed his | 
phonics to be quite equal to that of the average child in the fii 

Summary of case.—A year ago, Henry was not able to 
work in reading and spelling. After four months’ instructior 
into the fifth grade and has had no difficulty in keeping uy 
grade standards for the five months of this year. He is now 
half of the fifth grade, and is reported as reading books of ever 
out of school hours. 

CASE Ill. BOY (FRED) 

Age, 9-2; menta. age (Stanford Revision), 9-3; I. Q., 1 
right, normal; left, two-thirds normal. 

School history—Fred attended the public schools of Rivers 
nia, where he entered the kindergarten at the age of five. Hi: 
years in the first grade. He entered the University Training 
tember, 1920, and was placed in the second grade but made no; 
the first month. He was unable to read words of one syllabk 
quently was too poor to be tested by any formal test. He was 
Psychology Department for a mental test with the definite sug¢g 
he be transferred to one of the public school rooms for the ment 
The child had so much the appearance of a mental defective t! 
surprised at the results of the mental tests. 

A month after his entrance into the University Training S 
was given tests in phonics and in spelling. In phonics he wrot¢ 
lated forms as the following: for on, am; for at, oot; for in, in 
In spelling he missed all but two of eight words, writing the foll 
for the words given in parentheses: 


(day) 


FIGURE 1. WORDS WRITTEN BY FRED SEPTEMBER 29, 


’ 


r 


4 AU. Td re 
Flot» 
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learning first words. Fredspent the morning learning to write 
rds will, you, am, boy, all of which he had asked for. The words 
t one at a time; each being written by the teacher on the board. 
h word over and traced it with his fingers until he was sure he 
It was then erased, and he attempted to write it. If the 
was not successful, the entire process was repeated until the 

tten correctly. 
eeded in writing each of the words correctly in the course of 
In the afternoon he attempted to rewrite the same words with 
+ results: W (for will); Yo (for you); ow (for am); 6 (for boy) 
re retaught and then written correctly. He then asked for the 

1 wrote: 


Iam o boy 


s sentence with his left hand, then with his right. There is 
Says he 


| 
han 
left hand 


e in the performance with the two hands, but Fre 

d better. He usually writes on paper with his 
ard with his right. 

RECORD OF FIRST WORDS LEARNED BY FRED 


Number Date Number 
Word | of Times || (October) Word of Times 
Presented Presented 


last 
little 


Pine 
b« 

tree 
door 
box grew 
open 
mouse woods 


and 
October 


+N, ner. 1921 363 
will 2 7 1 
| 0 7 yes 2 
you 5 8 1 
1 | 3 
int | oO 10 
¢ am 3 il | 1 
a 12 0 
2 
| 
0 
i 5 
7 0 
7 
2 
s | 2 13 0 
25 0 12 of 1 
we 1 13 0 
7 day 3 12 words 2 
7 1 21 0 
0 
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October seventh.—He wrote correctly from memory the 


he had learned the previous lay, then asked for door ar 
me hese words, he asked for pen, adding 
I n write open the door.”’ When the word 
et er bre | said Erase it quick so I can write es ] 
he tence (/pen ti till the mouse pump ul. The 
nes before Fred could write it correct] 
r vord was written by the teacher and tr 
e he could write it 
I II gives the record of the first words learned 
ber of times it was necessary for ear of to be presente 
e to write it yrrectly lable II the res 
e the same words on later dates The \ words were all as 
For the next three weeks Fred went through an org 
te blackboards full of words, then began to write sent: 
ite the letter to his father, as shown in Figure 2 


Porat dd, 
Ju “ant camy 


J 


V0 


FIGURE 2. LETTER WRITTEN BY FRED WITHOUT ASSISTA? 
VEMBER 10, 1921 (THE WORDS IN THE LETTER HAD BEE? 
PREVIOUSLY ASKED FOR AND LEARNED 


This letter is only one specimen of the spontaneous comp 
which the boy kept himself occupied by the hour. It was writte 
after the attempt to write the words given in Figure 1. He was 
ng for new words which he learned and wrote from memory. | 
month after writing his first sentence, Fred seemed to care 
subject matter, so absorbed was he in mastering the mechanics g 


He worked so constantly and so hard that it was necessary to f 


leave the room at recess and at the close of school He looked I 


after working for two hours at new words and exclaimed, ‘‘S 


i 
( ub 
ou | | 


tion 
Oct 


1920 


rd 


rd pro inced 


ten tor nl 


them over 


it was never necessary for Fred t« 
ie to look at printed words of severa 


= 
é 
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to get pr moted al d now just look at all Ian learnit g ” 
ttempted to teach him w rds without having 
‘ Rae He would trv to learn them by saving then 
sr ther but would soon be me dis raged a \ ld 
e words aiter ted present Lio! | ittitud nt 
e experiment is particularly interesting, because at t} 
} 19?1 Fred no | nger wishe ‘ rite unle he 
t sav. but is re ding everything he can get hold of He 
: ng out new words without writing them as he ever 
g proce 
] ! ition of written with printed rd Word 
ere tten for him on the tvpewriter or were s vn 
é 1 written them Simple reading exercises were give! 
id vrntter 
the results with the first words studied for the purpose 
ted word was first shown the boy and then written lor 
t on first presentation as he did the words in Table Il 
ed t vrite word a second time inless he failed to recog 
enantations Column 3 shows the number of presentatio 
the word was written < rrectly 
RESULTS OF FIRST WORD RESENTED FOR 
RFADIN PURPOSES 
N er Date o N cr 
b Wor pres first of pres 
/ enta presenta Word ent 
2 build 3 
ere red ; 
r 20 mont! 
| ld } lee 
rs dinner | 
| thanked 3 21 chair 1 
ls bowl 4 
| over l 2 
| ne 2 ear I 
nant heard 1 
| e 1 1 
g Pha Writing the 1 Hi from memory after looking at the printed 
BE .— Within six weeks after the experiment 
ive the word writ umm 
4 
a | syllables, say ME to 
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himseli and write them correctly from memory. On Noven 
he wrote disappointed, department, university, and trainin, 
the words once in print. A week later he recognized all of thes¢ : 
out any hesitation, and without havir g seen them in the 

| Development of projects in connect n with reading ay 

ber eventeenth Fred suddenly decided that ne wanted t 


»wed to do so as long as he wished. He drew a picture of 


house and garage with heating system. His p 


r 
i¢ 


in Figure 3. |] 


was then suggested that he lal ei nis pict 
pleased him greatly. He learned to write the following s 
them as labels: cann n, shells, pipe, step 


PS, Wink 


FIGURE 3. PHOTOGRAPH OF ONE OF FRED'S DIA 


November eighteenth.—He wrote correctly without pri 
following words which he had previously learned: you, ride, | 
hide, pipes, rope, because, farage, cannon, want, Riverside, Decen 
will, live. He then wrote above the words on the blackboard, ‘7 
are save | 

November nineteenth.—He was taken to the library and 
two books: Lynde’s Physics in the Household, and a book 
From November nineteenth till December sixth, Fred drew 

i diagrams, finding the words in physics and plumbing books. H: 
! unable to recognize new words. after he had been told wha 
unless he wrote them. One w riting even of very difficult words was 


all that was necessary for word recognition. 

November twenty-second.—Fred read the following paragray 
being told any words exc ept those enclosed in parentheses: 

The cooler water in the radiator (being heavier) sinks from t 


into the furnace (boiler) and (forces) the hot water from the 


D 


the radiator. This hot water gives up its heat to the air in the 


thus) cools (contracts) and becomes heavier. It then sinks } 
boiler and forces more hot water into the radiator 


“ur 
] 
| ck 
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yaracraph was read just one and a half months from the 
yuld not read the simple sentence “J amal 


time 
He stumbled 


ple word like thus which he had never written, but had no difficulty 


” 


AL tial ii 


nv of the much harder words which he had written 


He was 
h time he failed to read it, but nable to recognize it 
resentations until he had written recognized it 
t occurred. 
i Fred suddenly stopped drawing and labelling diagrams 
ting on the blackboard sentences which he wo 


‘ uld sometimes 
} 


ith pictures. These sentences and oth 
ere then ty pewritten and given him to read Q 
es with a picture of a racing machine at the top of the sheet were 


fter a visit to the automobile machine shop 


A RACER 
ine automobile 
wheels on it. They have tires and 
ng gear, and a crank on the fro 
shield It has a radiator 


i racer 


sasoline runs the engine. 
idiator has water in it to cool the engine 


gine has eight cylinders 


chine has United States tires 


>is a fine one 
fan helps keep the engine cool 
s machine can turn corners going very fast and it won't wreck 
December 13, 1920 

he following 206 words, written from October sixth to December 
nty-second inclusive, are arranged in the order of the frequency with 
h Fred usedthem. The numeral after each word indicates the number 
mes it was used. 
On December 22 all the words in this list were shown to him and he 
gnized all of them except the four marked with an asterik 


25 water 11 because mi 
cannon on 
want 10 has Riverside 
pipes words 
it radiator 
come 
cool a draw 
furnace a) fine 
ride i fur 
ittle 
hot.... ide October 
will iv page 
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This is a 
It has f mud guard 
It? a 
It has a W 
It is a Mack and it ls ooo 
It runs awfully fast 
Gas 
rhe 
The en 
TI 
wl 
rec 
these 
5 
u 4 
the 4 
t 4 
4 
Ke 4 
4 
4 
' f 
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ve + in 2 closer 1 or 
red $ saw 2 coming 1 r 
r 2 corners | 
woul 2 linders 1 ne 
$ ine 2 dadd 1 l 
ystem 2 d 
3 tank 2 department 1 
; x 3 *thanked 2 didn't 1 r r 
} 3 tires 2 dinner 1 railr 
imbrellas 2 d ppoint 1 r 
r 3 university 2 drew | ro 
we 2 easy | rul 
rank 3 wires 2 eight 1 ru 
December 3 window 2 expect 
: door 3 wood 2 fan 1 
| bout 3 won't 2 faster 1 Sig 
wreck 2 fields 1 sit 
n ‘ fireplace 1 sk 
Mrs 3 ross 1 four 1 l 
rom 3 r ] front 1 x 
: st 3 in 1 garden 1 | 
up , as 1 gasoline 1 Star 
auto 1 gear 1 Stes 
3 iutomobile 1 1 st 
aw/ully 1 going 1 tail 
ure 2 ball 1 grew 1 thar 
irit t 2 bears 1 heard 1 that 
tur 2 beat | hel; | track 
2 long | here 1 r 
have 2 rthday 1 holiday 1 trick 
I 2 lew 1 house 1 troll 
n 2 bourd 1 hurt 1 tur 
last ? boat 1 *io mey 1 unabl 
2 bought | letter 1 inde 
2 boiler 1 lot 1 Un 
2 bowl 1 lazy | ver 
now 2 bridge 1 middle 1 walk 
of 2 buttoned 1 motor 1 warmer 
open 2 buy 1 mud guards 1 wheels 
pipe 2 cackle 1 my 1 wir 
pussy 2 carry | name 1 writing 
read 2 chair 1 never 1 
ring 2 circus 1 November 1 
All but four of the words in the above list were asked for by Fr 
learned because he wished to read or to write about some particular 
' rhe four exceptions were “department,” “disappointed,” “univer 
and “training” which were given to demonstrate the readiness with which | gra 


could learn new words. 


| 
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ers after the words indicate the number of separate occasions 
word was written in context The boy often wrote a wi rd 


gain voluntarily, erasing it each time it was written, but as 
s the actual number of times each word was written 
an indicated. 
twenty-second.—Fred began to ask for new words 
without writing them. December twenty-fourth—January 
vacation. 
Ability to pronounce ne if they resemble words 
January twenty-fifth —Fre de the word mother 
er several times 
hout being told, and began to attempt the same t 
fourth.—He worked out, without writing or any 
rds: surprised, roar, fright, noise, thirsty, 
jreadful, pronounced towards, to-wards, at 
of the Fox and the Lion to himself an 
He had never heard or read the story before 


Words were given to Fred from the pages of the third 


ds on various pages were given out of context to see 
| 


them without having them pronounce All the 
new to Fred so far as we know. ad a 1e words in the 
mispronouncing only those w In each case 
unciation is indicated. 
money stin *Snly 
with ash wounded 
tripped juite howled 
*warmth 
frozen 
traveler 
chestnut branches 
graceful whining 
*grinned *rattling 
monkey apple 
second grave 
late of writing this paper (March 1921), Fred’s progress is so 
it is difficult to keep records. He takes library books home, 
nself, and has to be told only such words as might trouble any 
ge. He has been in the regular third grade for two weeks and 
difficulty with the work. If his progress continues at the present 
ild be able to make up the one year necessary to put him in the 
priate to his chronological age. 
ary of case.—In October 1920, Fred could not read or write even 
bic words. He failed completely in all tests for reading, spelling, 
s. His school report showed stead: ice with failure of 
in the city schools of Riverside, California taken for 
i that he was mentally deficient until mental tests proved him normal 


' 

M third. — 
grante 


At the beginning of the experiment his progress was ver 


e words first learned 


Seer 1 who! epende on tracing 
t ice for over two months. His development went through » 
stag with the transition from one stage to the next appa 


In March 1921, five months after the experiment was 


} 


reading and writing (spelling) well enough to go into the reg 
» | ry } | h TY r 
H i LKINng library DOOKS Nk ne to read to himself and 
no ry and give its content 


CASE VI JO! 


ee 


Age (June 1919), 12-5; mental age (Stanford Revision), 15: ] 


vlete, this case is reported because it diff 


respects from our other cases. Jn the first place, in spite of the 
showed almost no ability in reading or spelling, he d 
| through the first two stages described on page 355. Fr 
he could write a word from memory, after seeing the printed : 
| pronounced for him, and pronouncing it himself. Thus, he wa 
i with what had proved the third stage in all our other cases. /) 
place, the experiment was discontinued before the fourth stag: 
Joe had learned many new words so that he could read fairly 
LOpICs; the work with rapid apperception of phrases had beet 
the stage had not been reached in which new words were apper 
sis of their resemblance to words already learned The progr 
case during the year and a half of regular school work since the 
was discontinued is of interest in comparison with the progres g 
cases in which the experiment was completed. 
SCHOOL AISI Joe has attended the Los Angeles city scl 
was six years old. From the start he has seemed to be unable 
read but has been passed from grade to grade on account of 
other subjects, particularly in arithmetic. His grades in t! 
ranged from 8 in arithmetic through C— in geography and 
English. When questioned as to how he kept up the reading « 
his school subjects, he explained that he had always managed to 
a boy who could read easily. He helped the other boy with pr 
return for help in reading 
Joe was referred to us in June 1919 as a sixth-grade failure. | 
) gation of the case showed that the entire difficulty was due to 
complete inability to read. There had been considerable disc: 


case before it came to the psychology department, since two oth 
in the same family had had the same difficulty with reading. 
Ihe case was the more surprising because of the boy’s hig! 


| quotient and because of his history outside of school. He excelled - 

| like baseball and was very popular with other boys. The propri 


? At the date of publication, December 1921, Fred is doing satisfactory) 


| upper fourth grade 


| 
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here he worked out of school hours reported that he cx 
1 most men. 

1e to our attention a 

to a summer school 

d this school intermittently 

w hours of spec ial work, exten 

tered the seventh grade in the fa 

1921) in the eighth grade in one of the regular Ls 
he is reported as doi satisfactory work 


The method was the 
— tended t 
r joe never tendet o trace words 


them directly from the printed copy 
it was only necessary to pronounce 


to himself as he looked at it, 
saving each syllable as he wrote it. 

Although the results of the first readi 
t entirely negative, Joe possessed from the be 


in new words by the method just described 
was unable to recognize short, ordinary word 
for him, he was able to look at a difficult 

ne. and write it correctly from memory, provided he 
himself as he wrote it. It seemed to make no difference whe 

He could write a word like 


ner 
the meaning of the word or not. 
al after seeing it once and repeatin; re one, al 
rewrite the word, as well as recognize it, after an interval of seve ral 
His ability to write words in this way w: 
tention. It became one form of school en 
which Joe could not write. To this day he 


ds learned in this way. It was, of course, not 
to teach any but ordinary words. During 


hool he went over the Ayres thousand-word lis 
rable reading vocabulary. 
idy of Joe as he works shows that he is more dependent 
er children on saying the word as he writes it. Hen akes 
ments as he says the syllables to himself and fails com} 
suppress the lip movements. 
isually remembers for an almost indefinite perio 
t fails on a subsequent presentation to recognize a word 


{1 any word he 


told repeatedly but which he has not written. At 
hool, when the experiment was discontinued, he I 
where he was beginning to make out a few new wo! 
r resemblance to words he already knew. For the! 


the 
Lhe ¢ 


|] not able to recall words unless he wrote them 
f phrases had just been begun. 
In the fall of 1919, Joe went into the regula 
his studies, except Englishin which he 
eveloped sufficient reading ability tokeep up wit 


na 


1 ana di 


riled ie seemed to have 


f 


is work in other subjects. 


rh 


N 

uld Keep 

year, we 

ould be 

I ice then 

out two 

half 

reles city 

l J ed except 

I and was able from the 

Consequently in the case 

" t for him, t ive him 

to have him write it 

d and spelling tests 
ning a remarkable 

ctl he ave ol 

‘ veloped 
\ in any 

ir marke 
if he ts 
H as ever 

Nritt hich he 

a d ol th 

id reache the 
ren t n the basis ol 
t rt, however, he 

Work in rapid apper 
did fairly 
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The « xperiment was discontinued because his teacher. since he 
e work in most of his subjects, considered it unnecess 

for the special reading work 
In March 1921, we found Joe in the eighth grade of the reg 
chools He was reported as doi! gy Satisiactorv Work 
e requiring reading. Actual tests for reading 
give sixth-grade erage for spelling and very irregular res 
He grades anywhere from the third to the sixth grade by the K 
Reading Test, below fourth grade by the Starch Silent Re 
half the standard score for the eighth grade by 
Re ng Test 
The d pancy in the results of the silent reading 
explained as soon as one observes Joe while he reads. He make 


ents, and stops when he comes to some word he canr 


p nces some word to himself and so loses the sens 
In the latter case he begins again at the beginning and either 
gets the meaning or gives up. For example, in the Starch test 
grade, he missed the word waked, read till he came to dawn, we 
beginning twice, and finally gave it up after getting waked 
dawn. His score for Test 5 was much better than that for Te 
he did not happen to stumble over any particular word. 

He is still able to learn a new word almost as rapidly as he 
and say itto himself. To determine whether the writing of the 
essential for word recognition, the following experiment was tried 


He wrote the following words from paragraphs 8, 9, and 10 


Oral Reading Test: dignifying, station, position, securing, approxim 
; le > le he 
pulously, inclined, contemptuous, silence, complexion. Although h« 


to read any of these words, he wrote each of them correctly after 
presentation consisting only in the exposure of the word while 
inced and repeated once. The two words, ingratiatingly and 
were the only ones on which he failed. 

The words proportioned, exegencies, profusion, and exhausted wet 
him four times and repeated by him each time, but he was not 
write them. 

He was then asked to read the paragraphs again. He read corr 
vf the words he had written but failed on all of the four words w! 
been pronounced but not written. 

The results of educational tests given both at the beginning 
experiment and in March, 1921, indicate the amount of improvement 


Joe made during the interval. These tests covered the subjects of g 
and reading. In spelling, words from Column Q of the Ayres scale ¥ 
on June 3, 1919. Joe’s rating was 10 percent, which may be compa 


the standard rating of 58 percent for the fourth grade on words 
column. On June 9, 1919, words from Column Q of the Ayres s 

again dictated. This time, however, the test was given after the 

been learned. Joe’s rating was 90 percent. On March 7, 1921 

tested with words from Columns Q and S of the Ayres scale. On Column \ 


| 
| 
| | 
| 
| 
| 
| 
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¢ was 85 percent standard, 84 forthe sixth grade) ; while on Column 5 
s 80 percent (standard, 73 for the sixth gra ke In tl 
be noted that his school report for March 7, 1921, indicate 1 
g was “good 
‘ 1y judge the amount and character of Joe's lifficulties wit! 
consulting the following list of words trom ( Q of the 


as Joe actually wrote these words on June 3, 1919. In each 


1 in parenthesis is the word attempted. 
metimes) dclaer (de lare inga¢ engagt 
tory finel final cention 
terrible frem firm serprist 
regio! prived t 


idition 


property 


crowd 


e ITI shows the results at the beginning and end of the experiment 
he Gray Oral Reading Test. In June, 1919, his score was 7.5; 1n 
1921, his score was 28.75 


JOE’S RECORD ON THE GRAY ORAL READING TEST 


June 1919 Ma 1912 


Time 


Errors | 


tiate the Kansas Silent 
les. He was not given 
In March, 1921, 


e score 


In June, 1919, Joe was quite unable to nego 


gra 


Reading Test for the sixth, seventh, and eighth 
I (i.e.. the test for the third, fourth, and fifth grades) 
On the former he secured a rat 


is given both Test I and Test II. 
{ 61 and a comprehension score of 9 


On the latter he secure 1 a rate score 


In the Starch Silent Reading Test 
March, 1921: on the fourth grade test, 
11; on the fifth grade test, 1.2 words per seco! 


\n explanation of the inversion shown here is given e 


54 and a comprehension score of 13. 


he obtau ed the 


0.45 words per second, compre! 


d, ¢ smprehension 19 


lsewhere 
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privet privat in 
( ey) debate (debate sclet select 
Errors 
seconas Value second Value 
40 5 0 20 0 20 
? 40 3 10 | 20 0 20 
35 0 20 25 0 20 
45 6 0 29 0 20 
80 | 0 25 W 
6 10 | 0 30 3 10 
7 190 8 0 | 29 2 | 15 
we 90 7 0 
) 90 10 0 
following results in 
rehen- 
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Summary of Spelling and Reading Tests 
June 1919. Kansas Silent Reading Test. Failure on sixt 
and eighth-grade form 

Gray Oral Reading Test. Score 7.5 in compar 
as sixth-grade standard Below first grade if 
on basis of first grade test. 

1 yres Spelling Scale, Column QO. Score 10 perce 
for fourth grade 50 percent . 


March 1921 Kansas Silent Reading Test. Grade from thir 


varving with test forms. 
Starch Silent Reading Test. Below fourth, irreg 
Ayres Spelling Scali Sixth grade 
Summary of case In June 1919, Joe was reported as a si 


failure Investigation showed that the entire difficulty c ild 
failure in reading and writing (spelling). It was found that hx 
read ordinary material such as a simple arithmetic problem, though 


easily solve the problem if it were read to him. He failed almost 
in formal reading and in spelling tests. In spite of his inability 
spell, the boy was able to learn new words with remarkabk 
accuracy by the methods already described. 


After six weeks of rather irregular instruction, he had develop 
siderable reading vocabulary along certain lines and had been broug 
to the sixth-grade standard in spelling. He had improved sufi 
able to read his arithmetic problems and to do the work of the sevent g 


though he still read very slowly and stumbled over new words 


the year and a half since the experiment was discontinu 
has made little progress in ability to read to himself. He seems, } 


to have lost none of the concrete detail he acquired, and he still manag: 


LO 


read fairly well in those subjects for which he learned a specific rm 
vocabulary. His spelling continues to be satisfactory because he lear 
write new words easily, and is allowed to use the method developed g 


the experiment. Unlike our other cases in which the experiment 


il 


pleted, Joe has never shown any tendency to read to himself and so ha 


acquired speed and ease in reading. 


GENERAL CONCLUSIONS 

In all but one’ of the cases studied, progress seems to havi 
taken place in four distinct phases, as follows: 

Learning to write words.—In all cases the children were 
first lacking in ability to write words as well as in ability 
read. The development of ability to write words is very slow 
first. It is necessary for the child either to trace or articulate 
the word many times while looking at the written copy, and 
finally to articulate it as he writes it from memory. The need tor 


+ 


* Case IV did not go through stages 1 and 2 but began at stage 3 


. 
ind is 
4 
inte 
essent 
Pe 
and a 
after 
A 
has b 
| 


FACTORS IN WORD RECOGNITION 


radually disappears, but he continues indefinitely to 
in learning to write a new word 
iting the written with the printed word.—The child sees 
print, has it written for him, and then writes it him- 
tracing difficult words before writing them. He soon 
oint where he can generally recognize a word in print 
; written it. He must still have the word written for 
he is able to write it himself. 
write a new word from memory after looking at the 
ind repeating the word to himself —The word must, 
- pronounced for him before he is able to say it to him- 


He is still unable to recognize short, easy words on subse 


resentation if they are taught him in the usual way and if 
not write them. At this stage he will often write from 25 
rds a day. He rarely fails to recognize a word after he 
written it. 
to pronounce new words if they resemble words he has 
earned.— The end of this stage is normal ability to read. 
rogress at the end is so rapid that it is almost impossible to 
rack of the child’s development. He seems suddenly to read 
is able to enter regular classes in all work involving reading. 
first three cases the children not only developed normal 
to read, but became incessant readers. 
Effect of intelligence on method and learning rate-—The method 
ring was practically the same with cases of varying degrees 
{ intelligence, except that there was no tendency to trace in the 
ase of the two children with the highest intelligence quotients 
| cases the articulation and the writing of the word seemed 
tial for developing word recognition. The progress was 
| more rapid in the cases of better mentality than in those 
lower mentality. 

Persistance of kinaesthetic factors —Children who have to trace 
words in the early learning stages continue to make slight hand 
arm movements in attempting to recall difficult words or to 
new words. All the children make marked movements of 
articulation during the process of learning a new word, even 

iter reading has been well developed. 
Acquiring skill in penmanship and phonics.—Although there 
has been no drill in penmanship or in phonics, the children who 


375 
{ | 
| 
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trace words in their early learning stages write a ck 
and all acquire incidentally a good working knowled 

In all of our cases any digression which dir 
attention away from the word itself seemed to confus: 
than to hasten the learning process. The introducti 
formal penmanship drill, oral spelling, or even sp 
during the writing of the word seemed to hamper 
process. 

Individual differences —The cases studied differ 
in the exact kinaesthetic content necessary for the dev 
word recognition, the difference being in the 
and arm kinaesthetic experience necessary before 
written. Case IV did not go through the first and 
as described above. Although, in this case, th 
traced before it was written and did not have to b: 
script, it was necessary for the child to write the wor 


WOT 


could recognize it 

General significance of results —It may be well to 
that, although only extreme cases are reported in 
the results of certain experiments now under way seen 
that these general principles hold true of many cases in 
child simply has difficulty in learning to read. It seer 
least in many of these cases, the progress will become 1 
the proper kinaesthetic content is supplied. 


THEORETICAL 


Perhaps we can go no further in theory than to say 
the specific cases studied, lip and hand kinaesthetic « 
seem to be the essential link between the visual cue and | 
ous associations which give it word meaning. In othe 
it seems to be necessary for the child to develop a certail 
aesthetic background before he can apperceive the visual 
tions for which the printed words form the stimulus. E) 
associations between the spoken and the printed word seen 
to be fixed without the kinaesthetic links. 

The motor tendency is still obvious after the children b 
fluent readers. They seem far to outclass other children u 
same grades in their ability to look at new words, say 
themselves, and write them. All of these children sti 
pronounced lip movements of saying the words (not the letters 


| 
| 


FACTORS IN WORD RECOGNITION 


rning a new word, even after they have reached a point 
The children 


never trace a word or speak it aloud. 
1 in the beginning tend to make arm and hand move- 
learning a new word or attempting to recall a difficult 


ey are hopelessly confused as soon as they attempt to 
or to write a new word without saying it to them- 


iid seem that the methods of teaching reading have 
slected the kinaesthetic factors, except those which in 
press the word as written or printed. It has been taken 
ted that, in the case of all children, the visual cue is 


to arouse those associations which make this cue stand 


i meaning. 
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AN EXPERIMENT CARRIED ON WITH THE PUPILS | 
THE RUSSELL PREVOCATIONAL ROOM 


James H. VoorHEES 
Principal, Lynch School, Detroit, Michican 


| inci pal, 
The Prevocational Room of the Russell School co; 
about fifty pedagogically retarded boys who have been w — 


out of the regular grades through the Psychological ( 
placed by themselves as a select group. The fact that the « 
tion of this type of child from the regular grades affords a 
relief to the school system is axiomatic, but the purpos: |; 
experiment was to find whether the proposition as it 
can be defended on any other terms, that is, whether thes 
show any growth in academic knowledge? Do they pro 
| academic and manual instruction received here to the extent that 
/ they are better able to cope with life as they face it? It t 

to be expected that any investigation carried on with a | 
. group will speak conclusively for the various classes of t! 

in the City of Detroit. It is hoped, however, that in 

the growing importance of the problem the present wor! 


extended by others who will verify, repudiate, or modify t 
conclusions herein reached. L 
The present investigation, it will be seen, divides 
naturally into two distinct phases: first, the measuren 
growth or gain in knowledge of the academic subjects pur 
the room; second, a follow-up study for the purpose of fir 
exact situation of those who had gone from the room to b: 
members of their respective communities. To determine | 
amount of growth in the subjects pursued by the boys, the | \ 
lowing Detroit Standard Tests were given: spelling, arithmet : 
geography, writing, and the Trabue Language Scale. The init ef 
tests were given on separate days during the first week in Janua: 
1919, and the final tests were given during March. Figure | : 
shows the results of these scores. It is to be noted that th: r 
| tests were identical in every case and that the period betwe: : 
initial and the final tests was about two and a half month 
arithmetic test was a test of the four fundamental operations | 
A gain of 16.5 percent was made in spelling, and a gain « - 
percent in arithmetic. The class apparently had not proit , 


from the instruction received in the other branches during U 
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k interval. The loss sustained in city location may have 

ue to the fact that but little drill had been given on cities 
e intervening period. The small variation in the scores 
handwriting (not shown in the figure) language and state 
tends to indicate that each test was a fair representation 
jividual abilities and that their limit had been reached. 


[Artec [Langage 


Median Scores, 


------ January Scare 


— March Score | 


GROWTH IN ABILITY MEASURED BY CERTAIN TESTS 


\ second experiment in academic measurement was carried on 
ring 1919-1920 in the same room. This experiment was an 
ittempt to determine the relative growth in academic knowledge 
of the Prevocational Class, of a class of the same mental age, and of 
i class of the same chronological age, all within the same building. 
\ class of B-third-graders was selected as representatives of the 
same mental age, and pupils of the grade who were at age, neither 
retarded nor accelerated, were chosen because the average mental 
age of the prevocational group was nine years. A class of B- 
eighth-graders who matched these boys in chronological age was 
ilso selected. These three groups were given identical tests at the 
ame time in December, 1919, and in May, 1920, the interval being 
ibout six months. It was apparent in tabulating the results of 
these tests that the third graders were the best to use for compari- 
on, the eighth graders having registered too high a score in the 
initial tests even though the time allowance was adjusted. The 
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time allowance for the third graders and for the pre, 
class was the same in all tests. 


This experiment seemed the more interesting be 


longer intervening peric«d between the giving of the t 


cause of the fact that the prevocational boys were give 


teacher during five of the six months that the experiment 
tests consisted of the following Detroit Standard Tests 
tic Test No. 16, an addition test; Arithmetic Test No 


ing test; 


Test 1B, a sentence organization test: a sp: 


made from the Ayres scale; a writing test, measuring q 


rate; and a silent reading test, measuring rate of reading 
of « omprehension. All of these tests were identical exc: ptt 


ing test, which was devised from the Ayres scale by selecti 
ent words of the same difficulty for the initial and the 
The results of the handwriting are shown first. It is w 


here that a program was arranged by the teacher wher 


boys were given a twenty-minute lesson in penmanship | 


three times a week for a four months period by the assign: 


manship instructor of the school. The results of this exy 
are compared also with the results of the year before wher 
tically no attention was given to penmanship as a subject 


shows the scores made in these tests. 


LAST WESENT EAR 
nly ale Qua ty 
— + 
4 
A. 
L 
Median Scores By Ayres Scale —Penmans! 
j Decem! Scc Ma DLULC 
FIGURE 2. COMPARISON OF GROWTH IN PENMANSHIP OF A 


CATIONAL AND A THIRD-GRADE GROUP 
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e quality of handwriting was shown in each test of the 
in the scores of 1919-1920 the same quality was 

ch test while the rate had slowed down six words 

e class had not profited by the four-months period of 
.nship instruction. The experiment was very much 
however, in view of the added light thrown on the 
The third grade over the same period of time 

in in quality from fifty to fifty-five, and in rate, from 
‘en and three-tenths to forty-three and five-tenths 
inute. The quality was ten points higher than that 
ocational boys, and a good gain was made in rate of 


3 and 4 show the results of the scores made in arithme- 
e organization, and spelling by each class 


CUMPARISON OF GROWTH OF A PREVOCATIONAL AND A 
IRD-GRADE GROUP MEASURED BY TWO ARITHMETIC TESTS 


The outstanding feature of these graphs is the great similarity 
een the gains of the two groups, and the low scores of the pre- 
tional group. For example, in the addition test the prevoca- 
oys had profited by this six months interval to the extent 
ey were able to attack two more problems, the third graders 


ore; the boys were able to solve correctly one more problem 
lition, the third graders one more; in the reasoning test both 


| 
| 
‘ 
| Aighes | Treats | Rights | Trrale | Aghts | 
| 
4 metic Test AW Addiflon Arithmetic Test A 
ber Test fay J | 
| 
ne | 
In 
| 


Prevocational) Thoud Grade Prevoca 
=: 
@e + + 
ga ation Sest 
| | 
Al > I 
| r= Tt al 
er Tt May 1 
me 
FIGURE 4. COMPARISON OF GROWTH OF A PREVO¢ ATIONAI \ 4 | 
rHIRD-GRADE GROUP MEASURED BY AN ORGANIZATION 
TEST AND A SPELLING TEST 


groups stood the same as far as gains and ability to solve corr 
were concerned. In the organization test the prevocational 
lost four points while the other gained twenty-four points. Th 
amount of gain here for the third-graders is possibly due t& 
better understanding of the test after having taken it or 
the last test is probably a better measurement of their 
than the first one. In spelling the prevocational class see 
have profited more by their course of instruction over 
months period, having gained about 9 percent, while the 
gained but three percent. However, this is about 7 percent 
than the gain made in spelling the previous year. The present | 
is believed to be a better criterion of their spelling ability 
it consisted of different words, thus avoiding the possibility 
carry over; while in the test of the previous year identical! 
were used. 

Figures 5 and 6 show the scores made in the silent-reading test 
Here, too, we observe an equal ability, but a greater gail 


+, 


by the third-grade group. In the initial test the prevocat 
boys read on the average 143 words per minute, and 14/ 
in the final test; the third grade gained from 105 to 145 wor 


gain of 44 words per minute, and a rate which exceeded that 
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up by two words. In ability to ap gine the printed page 
meet tional boys made a gain of 5.5 percent, the third- 


owed a gain of 17 percent and ranked but 1.5 less than 
itional group in interpretative ability. 
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It is quite apparent from the scores made in these tests +h. c 
the prevocational group has about the average ability of B-thir- 
graders. As a matter of fact, in most of these tests s: ¥ | 
percent of these boys made scores in excess of the third-grad, 


and they did not profit by their course of instruction over | 
months period as did the third-grade pupils. 


DISTRIBUTION OF CHRONOLOGICAL AGES 
~ Prevocational Group ~ 


= —— = = 
14 to 


Median Age 15-4 


[5 to 1S 


FIGURE 7. DISTRIBUTION OF CHRONOLOGICAL AGES OF TH 
VOCATIONAL GROUP UNDER DISCUSSION 


Before drawing further conclusions it might be well 
from this phase of the experiment and get the status of this parti 
ular group of boys from another angle. Figure 7 represents t! 
distribution of chronological ages on June 1, 1920. The boys: 
approximately from fourteen to seventeen years of age, wit 
teen years four months as the median. They are, therefor 
judging them by the scores made in the tests, on the average, six 
years behind in school work. 

Figure 8 represents the distribution of intelligence quotients 
The range here is from fifty-one to seventy-five with sixty 
as the median. Seventy-one percent of these boys had an I. () 
less than seventy. In view of this fact it is not at all difficult t 
account for the low scores and little progress made in the academic 
branches. 
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Medien .64 


DISTRIBUTION OF I. Q.’s OF PREVOCATIONAL BOYS 


re 9 shows that these boys spent from one to six years, 


average of two years three months, in the special room. 
a sufficient period for them to have profited by both the 
ic and manual instruction if it were possible for them to do 
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The purpose of the second phase of this investigatio: 
take an invoice of all the boys who had at some time been : 
of the Russell Prevocational Class. A list of 125 boys w 
ingly made, all of whom had been away from school fr 
three years; but, owing to the migratory tendencies of t 
classes which these boys invariably represent, only 
located. Of this number, 27 were found to be unemp! 
13 of these had not been employed since leaving 
the rest were out of jobs for various reasons. Many had be 
planted by returned soldiers, and possibly many wor 
have been employed had it not been for the great labor 
during the war period. Two boys were found in free hos] 
in the State Institution for Feeble Minded, one in the 
one in the navy. Two bovs had served time in the State | 


AVERAGI VEEKLY WAGES 
VOCA . Al D CONTINU i [ON BOY 
Af 
4+ T + —4—_ ——_ — - 4 
4 — _ £ 
4 — 4 -+— 4 
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FIGURE 10. COMPARISON OF AVERAGE WEEKLY WAGES OF 10) a 


ONE TO TWO YEARS OUT OF PREVOCATIONAL SCHOOL A* 
AN EQUAL NUMBER OF BOYS IN CONTINUATION SCHO‘! 


School but had been released. Fortunately only one individu 
taken upon himself marital duties. He, finding them too stre1 
ous, however, had returned to his parental domicile. Only sever 
boys were located who had held the same jobs since leaving s 
The character of employment and the wages received by 
boys seemed to be of vital importance; and in order to make : 


pl 
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e analysis, the average weekly wages of an equal number of 
the continuation department of the Cass School were 
Figure 10 shows the results of this part of the investiga- 
[he reader should bear in mind when looking at this graph 
| of the prevocational boys were from seventeen to twenty 
age, while the continuation group were all in their six 
year. The average wages of the boys from the prevoca 
lass were two dollars per week more than the wages of the 
ition boys. A similar situation was found even in the same 
activity as is shown on the right of the figure. In factory 
eir average excess was two and a half dollars per week; in 
ering parcels and messages it was two and a half dollars per 
ind in store work twenty-five cents per week. 


PREVOCATIONAL GOYS 


CASES OF PREVOCATIONAL AND 


CONTINUA 


11. DISTRIBUTION OF 
CONTINUATION SCHOOL BOYS BY OCCUPATION 


Figure 11 shows the number of boys from both groups em- 
yed in various lines of activity throughout the city. The 
upremacy of the continuation group is here clearly shown, as 
ny of them are found employed in activities for which the pre- 
vocational boys are not qualified. It might be added here that of 
the 75 continuation boys investigated, 57 held the same position 
throughout the year, and that the eighteen who changed their 
places of employment apparently did so to better themselves. 
They were all enrolled in continuation classes, pursuing courses 
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that had a bearing, in most cases, upon the particular field j 
they were employed. On the contrary the prevocation 
seemed to be victims of circumstance with no definite view 
pose in life, getting a job here and there wherever they c 
someone to hire them. They seem to be most successful in | 
tory. No doubt it furnishes the best opportunity for this 
boy because of the better wages and the greater field for 
typed work requiring a low order of intelligence and initia: L 
the factory some of the boys were found to be operating 1 

but most of them were doing roustabout work, such as | 
trucks and sweeping floors. No boys were found to be doing at 2 
work or to be making any direct application of the training th, re 
had received in the manual training room. 

It might be held that an investigation of this kind ii 
nothing because a repetition a week later would find some of thes ra 
idle ones employed. However, from the general trend of irs ft 
one would be more likely to find some of the employed on 
As a matter of fact, a survey of the 25 boys who left school durin; ofa 
the last year, who were not included in the 75 previously re: 
shows similar results. Thirteen of these boys were foun 
working, three of whom were not regularly employed; thre: au 
selling papers; and only two had remained on the same job sinc ret 
leaving school. One of the twenty-five was deceased, and « 
were known to be idling on the streets. 

The conclusions from the investigation seem to the writer t in | 
of lesser importance than the fact that the work was carried o1 bro 


The inference drawn may be faulty, but the only hope for a 1 ing 
satisfactory solution of this problem as it now stands lies in pl 

tinued work along these lines. As far as the present survey went, it thr 
would seem to challenge the term “prevocational”’ as applied | Tl) 
this particular room, because the instruction offered there seem: ad 
to have no bearing upon the work of these boys after they leit co! 
Whether this particular room is a failure in the educational schem« her 
of Detroit depends entirely upon what the room is expected | sen 
If it is intended for pupils who are retarded and who are later to! 

reclaimed for the grade, it falls short of its purpose, as only ont vis 
boy is on record as having returned to his regular grade. Ii U 

purpose of the room is to furnish a relief to the regular grades, b) ing 
eliminating that type of child who does not get on well there, it ity 
does all that is expected of it. It is also true that this accomplish an 


ment alone is a great piece of constructive work in education. It fac 


| 
| KE | 
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| seem, too, that this is about all that can be hoped for under 
present order of things. It is generally conceded by those who 
informed that this type of boy will not go very far forward 
lemic studies, and the present arrangement emphasizes aca- 
instruction. The results of the tests in this experiment are 
es that these boys have not gone very far in academic 
ge, and the I. Q. ratings mean that they have not the 
ilities of improving their intellectual status to any great 


f any definite conclusion can be drawn from this investigation 

it is this: that as far as proper returns for efforts expended 

ncerned, these boys are able to compete with the usual lad far 

re satisfactorily in the industrial world than they are in the pur- 

f academic knowledge. If that be true, it follows that the pro- 

for these children should center around the industrial idea. 

t to be inferred that they should be trained specifically for 

les; a general training centering around their probable field 

‘activity is possibly the best that can be done for them. They will 

r happier in life if they are able to read, spell, write, do simple 

etic, understand healthy living, and have regard for law and 

thority; but outside of these limits they will no doubt get better 

returns for time and effort expended if their energies are directed 

along vocational lines. 

Certain advantages for a program along these lines can be seen 

1 centralization plan. For instance, larger groups could be 

‘ken up into smaller like units, a departmental plan of teach- 

ing effected, a wider range of manual instruction offered, and a 

lacement scheme adopted whereby these boys could be given jobs 

igh the affiliation of the school with the factory or the shop. 

[his scheme could be defended from two angles; first, the apparent 

adaptability of the children concerned, and second, the economic 

condition of the parents whom they represent. It might be added 

here that the average number of children in the families repre- 

sented by these boys is five, that the father is in most cases a day 

laborer and a renter, and that every one of the hundred homes 

visited, required all or part of the boys’ daily earnings for their 

maintenance and support. Many of the circumstances were press- 

ing. If, therefore, a program of this type could be made an actual- 

ity, it seems probable that the proposition could be better defended 

and that the problem of the exceptional child could be more satis- 
factorily solved for every one concerned. 
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THE RELIABILITY OF PREDICTION OF PROPORTIoO\x< 
ON THE BASIS OF RANDOM SAMPLING 


Ben D. Woop 


Teachers College, Columbia University 


The layman and the statistician of little experienc: 
difficult to accept with any satisfactory degree of contid 
dictions based on proportions of comparatively small 
samplings. For example, if it is observed in a random s 
consisting of one-quarter of all the sixteen-, seventee: 
eighteen-year-old boys in a given city, that 83.4 percent 
father as guardian, what would be the proportion of the rer 
three-quarters of such boys who would similarly hav: 
parent as guardian? The average layman would not eve1 
to guess within 10 percent of the truth, and he would ; 
laugh if someone should venture that it would be 83.4 
plus or minus 2 percent or less. Again, if for the above s 
were observed that, for 6.3 percent of the boys, the se 
high school was the last school grade completed, that 
percent sickness was the (reported) cause for leaving 
that for 9.8 percent $18 was the (reported) beginning 
wage, and that 2 percent left school at the age of 13 y 
average person would be far from ready to accept thesé 
thing like the proportions that would be observed in thi 
group. 

Many will welcome the evidence afforded by an e1 
study which recently came to light in the form of a test cas: 
is none the less valid for having been made somewhat « 
tinely by a group of skeptics. On December 3, 1918, th 
Vocational Bureau of the New York State Military Training Cor 
mission received a questionnaire card from each of the 6,468 
employed boys sixteen, seventeen, and eighteen years o! 
the city of Buffalo. About 275 public school teachers filled out th 
cards for the boys. The same thing was done in every part 
state; and in order to avoid the tremendous task of handlir 
many cards, the present director of the bureau, Mr. H. G. B 
upon assuming charge, gave orders that in certain units ra! 
samplings be taken which were to be studied in lieu of th: 
number of cards for such units. The group of subordinates in 
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TABLE I. RESULTS OF RANDOM SAMPLING’ 


Percent ol 


of Item Enrollment Description of Item 


25 : 100 


IV AGE Lt AVING \« 
Ten years or 
3}14.1)13.9 orno answer 


Twelve 
Thirteen 
Fourteen 
Fifteen 
pixteen 
ster or matron Seventeen 
rents Eighteen 


not related 


1 
4 


ver Last Grape Co 
r CHILDREN yurth grade or un 
FAMILY der or no answer 
3} 6.3 Fifth grade 
811.7 Sixth grade 
713.9 Seventh grade 
414.2) Eighth grade 
6)14.5) ist yr. H.S 
6)12.4 2nd yr. H.5S 
3rd yr. H.S 
4th yr. H.S 
Business school 
en or more 2|\VI. BEGINNING WEFKLY 
inswer 0.04/0.03 WAGE 
- $ 3.00 
N FOR $ 6.00 
EAVING SCHOOI $ 9.00 
incial 1; 9.9 $12.00 
nted to work 4/69 | $15.00, 
$18.00 
luated. $21.00 
ellaneous 3 $24.00 
sliked school 8.3) 7 27.00 
—E More than $27.00 
No answe 
mn 1 shows the proportions in a random sampiin 


1 ted 


k boys 16, 17, and 18 years of age who have the characteristic indicatec at the lef 
‘olumn 3 shows 


the proportions observed in a sampling of 75 percent (4 851 cases) of the boys, and ¢ 
: rtions observed in a 100 percent sampling of the boys (6,468 cases) This table 
columns of proportions for only six of the twenty-four items available for use in this study. 


Bufi 


2 


shows paralle! 


Percent 
on 
25 | 75 | 100 
— 
IAN OF Boy 
83 nder 
13 0.71 0.8 & 
¢ 0.2); 0.1) 0.2 
060.5) 0.5 
2.0'1.9' 1.9 
36.9137 .3)37.1 
09 0.9'09 
Ot 
l 
3.4] 3.4 
0 
14.5/13.5}13.8 
19.7/20.3)20.2 | 
23.7\26.9|26.1 } 
I 
23.820.4)21.2 
6316 2 6.2 
1.7} 2.2] 2.0 
1.8) 1.44 1.5 
3.21 3.3] 3.3 
10.1| 8.6) 8.9 
17 .4)18.0)17.9 
13.8|15.1)14.8 
11.2/10.9]10.9 
14.5/14.4)14.4 | 
283.634 
0) 
0 } 
7.1) 7.7| 7.6 
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charge of the Buffalo cards was so skeptical that some of the: rT 
determined to test, sub rosa, the wisdom of Mr. Burdge’s 
Accordingly, the 6,468 cards were put into strict al 
order, and every fourth card was extracted. The extrac 
thus comprising 25 percent of the total and representi: 
cases, were sorted and tabulated with the Hollerith ma Sq 
Mr. Burdge had directed. The remaining cards, compri 
percent of the total (4,851 cases), were run through the 1 
for similar sorting and tabulation. Finally, all cards wer 
together and the total 6,468 cards were put through the 1 
The results were placed in parallel columns as in Table | 
agreement illustrated ought to put an end to heresy. It i 
worthy that even in the items involving small numbers 
the proportions in the three groups are almost identical, cl \< 
demonstrating the sagacity of Mr. Burdge’s judgment 
matter. \ 
The parallel columns of the larger table from which | 
is taken afford material for comparing the theoretical wit 
observed or empirical reliability of the percentile meth 
random sampling. The formula for the standard deviatio: 
proportion is Su] 


Ipq 


in which p indicates the proportion having the character 
question, g the proportion not having it, and » the nu 
events or cases in which the proportions p and g are observ: 

We might test the validity of this formula by compari 
index of reliability which it gives with the index actually ol 
in the data illustrated in Table I. But the form of the data: 
it more convenient to test the formula in a slightly alter 
that is, the form which gives the theoretical standard deviatior 
(epp) of the difference of proportions: 


8) 


Ny 
This formula is nose derived from formula (A) by mea! 


the equation for the standard deviation of the difference between 


! The derivation of this formula is given in detail in chapters 13, 14 


1 


Yule’s Introduction to the theory of statistics, C. Griffin & Co., London, ! 
particularly pp. 257 ff., for all the theoretical considerations of this formu! 
the conditions of truly random sampling. 
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nding values of two variables. This equation (Yule, 
210 ff.) may be derived as follows: 
difference between any two corresponding values, x; 
f the variables. 


th sides of the equation and summing, 
= D(x?) + (x72) 
both members by », 
n 

if ry is the correlation between x, and x, and o*, o;, and ay 
respective standard deviations, 

= 07, +072 — 
¢ that r=0, 

ce the variab! are proportions, 

o*, =0*p,, where Dp stands for the difference of pro- 


o*; and 
072 =O" 
stituting these values in (1) 
— P292 


ny No 


Formula (B) would inspire us with more confidence if we had 
mpirical proof that it conforms to fact. If, for example, we 
id calculate ep, for various ranges of percentiles by the use 
formula, and if we should find that the standard deviation 
served differences of proportions in these ranges approxi- 
ted fairly well the theoretical ¢p,, then we should feel more 
ire in using this formula in working with percents. These cal- 
.tions for theoretical and observed standard deviations of the 
liflerences of proportions have been made roughly with results 
hown in Table II. 
he values in the column headed “Observed S. D.”’ were ob- 
| by distributing within each percentile range indicated the 
ifferences between every pair of proportions in columns 1 
and 2 of the larger table from which Table I was taken, and then 


\ssuml 
| 
141 242 
ny Ne 
| 
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rABLE II. STANDARD DEVIATION OF THE DIFFERENCES 0} 
TIONS EMPIRICALLY AND THEORETICALLY DERIVE] 
Percentile Number of Observed Dif iti 
Range ferences from Each Per- 
centile Range +2 
65 13 178 
65-75 14 2.15 
75-85 29 1.756 
85-90 22 1288 
90-94 25 1.259 \ 
94-97 30 0.7865 
97-98 § 17 0.3937 
98 5-909 5 27 0.2816 
99 5.990 & 10 0 1948 
99 8.99 9 12 0.0913 
99 9.99 97 10 0 09046 
calculating the standard deviation in the ordinary way « 
that the mean was assumed to be zero. Thus, in th« 
which Table I is a sample there were 13 pairs of propor 
within the percentile range 50-65. The differences 
these 13 pairs of proportions gave a distribution with a s 
deviation of 1.78 (without correction for assumed M =o 
The theoretical values of the standard deviation in 
column ot Table II were obtained by means of Formula B 
scribed above, namely ¢p, = y in which 
Ny Ne 
given proportion in Column 1 of Table I, g; equals (1—p 
equals the number of cases (1,617) involved in Column 1 of Table! 
P2, Jz, and mz (=4851) are the corresponding values for Co Z 
of Table I. For the purpose of this rough verification t 
formula, the midpoint of each percentile range was taken 
value of both p; and f:. Thus, for the range 50-65 (midp: 
57.5), the theoretical standard deviation of the differences 0! 
proportions is: 
(0.575) (0.425) (0.575) (0.425) _, 
1617 4851 
It will be noted that the observed standard deviations ar 


+ 


larger than the theoretical; but the differences are consistent, 
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m a practical viewpoint not large. The differences are due 
to the roughness of the calculations in both columns, partly 
slight inaccuracies involved in carrying the original pro- 
ns to one decimal place only, partly to the slight error intro- 
by assuming that the mean is zero in calculating the 
ed standard deviations, and largely to the fact that 27 
ely untrained teachers made out the cards. Such 
ations as these would justify reducing the denomi- 


Pid: P2qe 
+ 


My Ne 


5 


quite considerably, so 


the formula | 


increase the theoretical standard deviation systematically. 
er influence which makes for a consistent difference in favor 
bserved standard deviations is the inadvertent weighting 
ous differences of proportions by repetitions of sortings 
ig practically the same or dependent elements. This is 
the case in the second observed value (=2.15). This 
crept in before the fact of correlated sortings was 
the whole, the roughness of these calculations does not 
e very strong and unequivocal support afforded by empiri- 
ts for the theoretical reliability of the percentile method 
truly random sampling. 


i 
Wil 
i 


A SERIES OF STANDARDIZED DIAGNOSTIC TEs] 
FOR THE FUNDAMENTALS OF 
ELEMENTARY ALGEBRA! 


Hart R. Dovciass 
University of Oregon 
Standardized tests of progress in the study of mat! 
may be of two sorts, those which are primarily tests of p: 
those which are also tests of rate of work. Mathematical t 
scales, however, have been mostly of the latter type and 
with time limits such that few, if any, pupils are able to 
the exercises. On these tests the pupil’s performance 
described in terms of the number of exercises done corr 
of the number of exercises attempted in a given tims 
tests, with minor exceptions, consist of exercises of appr: 
equal difficulty, and the tests have been scored on that 
tion. For this reason the exercises selected for each test | 
of the same type, testing the same ability, and requiring t! 
degree of power of solution. 
The series of standardized diagnostic tests for m« 
power in the fundamentals of elementary algebra desc: 


this article are based on somewhat different principles 
struction. The intended function of these tests is to mea 
power to do certain types of exercises in elementary 

In the out-of-school situations in which algebra will be 


rate of work is clearly secondary to accuracy and withi 
negligible. A pupil’s performance on these tests is to be de 
in terms of weighted values of the exercises constituting t! 
and within certain large limits to be mentioned later, 
reference to time The exercises of the tests were select 
as to test proficiency na variety of subtypes of operations 
each of the fundamental processes of elementary algebr 
so as to afford considerable range in degree of difficult 
tests emphasize a more complete measurement of power and 
thorough and minute opportunity for diagnosis at the ex; 
measurement for rate of work. 

! These tests may be obtained from the University Co-operative Store, Ur 
of Oregon, Eugene, Oregon. Price, $1.60 per hundred. Those who use th 
standard conditions should report median scores and number of cases to the a 
Eugene, Oregon. 
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fundamentals of algebra.—The first step in the con- 
n of a standardized test for measuring school achievement 
inition of what is to be measured, i.e., in what field of 
r or in what portion of a selected field ability is to be 
ed. In order to answer this question for a test in ele- 
algebra a questionnaire was prepared that requested 
to whom it was addressed to designate the processes of 
as ordinarily taught in the first year of secondary schools, 
ey considered fundamental in the sense that addition, 
tion, multiplication, and division are considered to 
tute the fundamental processes of arithmetic. This question- 
is sent to one hundred members of the American Mathe- 
\ssociation, whose names were selected so as to include 
roximately equal division of teachers in secondary and 
schools, to provide for a representative geographical dis- 
n, and to include those known by the then secretary of 
ciation to be interested in the measurement of mathe- 

| proficiency by standardized instruments. 


GEOGRAPHICAL COMPOSITON OF THOSE MAKING REPLIES 
TO QUESTIONNAIRE TO DETERMINE ELEMENTS OF 
FIRST-YEAR ALGEBRA 


NUMBER OF TEACHERS 


GRAPHICAL LOCATION Colleges and | Secondary 
Universities Schools Total 


States 
Central States 
entral States 


Mountain States 


N Ww 


Fifty-nine replies were received. The geographical dis- 
ibution of the persons who replied is shown in Table I. More 
one-third are from the North Central states but all sec- 
tions of the country are represented. Table II gives a sum- 


mati 
st \ land 3 | 6 9 
ntic States 6 12 
2 4 
out 2 4 
Rocky 2 4 
J acific Coast States..... 3 | 5 
Totals... . 27 32 59 
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mary of the questionnaire. College and university 
agree very closely with instructors in secondary sc] 


reference to the operations of first-year algebra whic h ss 

considered fundamental. Four processes, (1) collectioy 

2) division, (3) multiplication, and (4) solution of si; 

tions received almost a unanimous vote. Four other | he 

received a majority vote. 
TABLE II. FREQUENCY OF REPLIES TO QUESTIONN: 


DETERMINE FUNDAMENTAL PROCESSES 0} 
FIRST-YEAR ALGEBRA 


NUMBER OF TEA the 
FUNDAMENTAL PROCESSE Colleges and | Secondary 
Universities Schools 
Coll on of tert Addition and sub 

tractior 27 32 
D n 27 31 
Multiplication 27 31 
Solution of simple equations 26 28 
Solution of simultaneous linear equations 19 22 
Factoring of type form 19 21 
Solution of simple quadratics 18 20 
Graphing 17 17 
Transposition 13 6 
Exponential manipulation. . 11 14 
Expansion of binomials 12 13 
Clearing of fractions 11 14 

Radicals 12 12 ’ 

Ratio and proportior 10 9 
Evaluation of formula 3 3 

For ng ¢ tions 4 1 9 


The content of the tests —For each of the four process 
were most frequently considered fundamental, there w 


structed a test consisting of ten exercises. This num! 
considered an adequate compromise between the desir 
of including a large number of exercises for minute measur ‘ 
ment and the desirability of a brief test which would no! 
an undue amount of time for administration. The fo 


considerations in the selection of the exercises were observ: 


| 


STANDARDIZED DIAGNOSTIC TESTS 


lhe exercises selected should clearly require proficiency 
e fundamental process for which the test was being con 


[he list of exercises in each test should provide for testing 
hief subtypes of difficulty and teaching units in each funda 


enta process. 


; The exercises should be so selected that a differentiation i 


ver would be possible on the basis of the degree of difficulty 
ved 

For the purpose of complete measurement and differentia 
tion each test should contain one or more exercises which could 
ved by only a small percent of first-year algebra pupils 
[hese principles were exemplified in the following tests 


oll 


STANDARD DIAGNOSTIC TESTS FOR ELEMENTARY ALGEBRA 
Test I. Collection of Terms 
Add 


? 


subtract 
15» al 124 
7a 


6 Subtract 
15a? 


4 
4 


Add 


7a 6a? + 10 and a? + 6a 7 
Subtract 
xX + X) 3y from 6x 3xy + 7y 
9 Collect Terms 
a? + 8a + 7a? + +7 4+ + 4 + 3a 


Collect Terms 


Test Il. Multiplication 


Multiply 2. Multiply 3. Multiply 
Om 4x 5 ab 
2 3x? -2 a’? 
4. Multiply 5. Multiply 6. Multiply 
+3 ay 4a — 3b 4a? — 2x 
6a") 2 ab — 
* These tests are printed on a four page folder, 844 x 11. The exercises are 


nged so that sufficient space is provided for the pupil’s work 


399 
in U 
atructe 
the 
| 
| 
4 ab 3a Sb tx 8a 3 ' 
11 ab 5a + 7b oY 6a? + 7a + 2 
0 
2x ry + 3y — 3x + Ixy + 7y + 8 | 
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Multiply, 8. Multiply Multiply, 
3) 7a* — 3: 3 ath 
4x + 2y -4ax* +2 


10. Multiply 
— 4a%cx* + 
+ 
Test Ill. Division 
1. Divide 12a‘ by 2a’ 


2. Divide 16x* by 

3. Divide by 2xy 

4. Divide 16x° + 28x* 24x° + 8x by 4: 

§. Divide 20a' 15a? 5a by 

6. Divide 142 28x* + 21x by 7x 

Divide 16a*) + by — 2ad 

8. Divide 36a5) + 6a}? 12ah* + 18a5* by 6a6 
9. Divide 6a 18a l1a* + 20 by 2a 5 
10. Divide r 19r +- 84 6r? by r 7. 


Test IV. Solution of Simple Equation 


1 Solve tor a 2 Solve for ¥ 
$a 12 Sy = 20 
3. Solve for a 4. Solve for > 
ta 3 17 55+ 6 = 18. 
5. Solve for » 6. Solve for / 
3b —6 = 14 
7. Solve for 4 8. Solve for a 
y 6a 10a 
3 4 6 7 14 
9. Solve for 4 10. Solve for x 
24 3x x 14 3x 7x l 
2 2 6 5 2 10 


A large number of recent texts in first-year algebra 


examined, and exercises were selected therefrom in confon 


with the above requirements. For example, in Test II 


plication, Exercise 1 is the simplest type of multiplicatio: 


may be called algebra, a positive literal by a positive nu 
monomial. Exercise 2, somewhat more difficult, consists i 
tiplying one positive literal monomial by another, involvil 
ponential manipulation, a phase of multiplication. In Ex 
3 and 4, the multiplier is a negative quantity; hence th 


plication involves a new element, that of the laws of sign 
multiplication. In Exercise 5 the process is that of findin 


product of a positive binomial and a positive monomial; w 


5 
i 
~ 
if 
uu an 
we 
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» the multiplier is a negative monomial. In Exercises 7 
multiplier is also a binomial, Exercise 8 being more 
han Exercise 7 because of the complexity of the literal 
Exercises 9 and 10 are more difficult and were inserted 
to differentiate among the abler students 

Uethod of administration—Sufficient blank space is pro 
yn the test sheets for all work necessary for the solution oi 
xercises. A testing of pupils in all of the subtypes of proc- 
ind on the varying degrees of difficulty requires that all 
ils have an opportunity to attempt all of the exercises. It is 
nt, however, that for purposes of economy of time pupils 
not be permitted to puzzle over the exercises indefinitely 
o seems that the pupils who work extremely slowly do so 
ise of an unsatisfactory grasp on the methods of solution, 


ling it necessary to retrace some of the work or to spend undue 


puzzling over the proper procedure; and they should 
uently, be penalized Hence, a time limit was set on 

t which would permit all workers to do all of the exercises 
ided they knew how to proceed without undue hesitation 
id not attempt an exercise more than once. On the basis of 
se considerations the following time limits were set: Test I 
minutes; Test II], 7 minutes; Test ITI, 9 minutes; Test IV 


es 


inutes 
since the purpose of the tests is not to ascertain how many 
ises may be done in a given time, and since the emphasis 
ced upon accuracy rather than speed, a measure of pro 
y may be secured which is not affected by the element o! 
ite of work, and which more closely resembles the demands ot 
life situations in which algebraic manipulations in question 
be applied. A psychological element of “hurry” is not 
used, and the likelihood of pupils failing to solve exercises 
‘use of excitement or undue speed is reduced materially. 
[he directions to the pupils suggest that they are to work 
arefully rather than hurriedly. They are told: ‘We want to 
see how many of these exercises you can do correctly. You will 
e given time enough to try all the exercises if you do not waste 
iny time. Work rapidly but do not hurry. Accuracy will count 
more than rapid work.” 
Weighting the exercises —The tests were given to 938 pupils 
in fourteen high schools in five states of the middle west and far 
west. The distribution of scores, the medians, 25- and 75-per 


i 
| 
\ 
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rABLE Il DISTRIBUTION OF PUPILS ACCORDING TO THE ny 
OF EXERCISES SOLVED CORRECTLY 


I 
NUMBER EXERCISES 

I 1] 

0 10 1 

1 12 

2 34 10 53 

3 70 17 62 

4 56 19 64 

) 118 74 71 

6 144 110 10 

7 152 144 150 

8 130 241 138 

? 128 217 99 

10... S4 50 101 

Total number tested 938 ROR 
25-percentile 4.44 5.87 
Median 7.16 | 8.27 7 %6 
Quartile deviation 2.22 1.67 2.51 


centiles and quartile deviations, from these papers scored wit 


weighting the exercises of the tests, are shown in Tal 
Weights for the exercises of the tests were determined by rei 
to the curve of probability and expressed in terms of 
deviation (P.E. or M.D.). <A zero point for each test wa 
mined by methods in recognized use.’ The weights 
reference to these zero points are given in Table IV 


Methods of scoring.—In out-of-school situations wher 


braic processes are required, the test of proficiency is ac 


Answers are either right or wrong. No leniency is show 


business dealings to the individual who “has the right n 


but who has made a small mistake.” For this reason 


facilitate scoring, solutions are graded either as right or as \ 


Full credit or no credit is allowed. Answers being 
except for arrangement of terms are not counted wrong 
sum of the weights of the exercises done correctly constitu 


score of the pupil 


‘Hotz, H. S. First-year algebra scales. (Teachers College Contribut 


Education, No. 90, 1918), pp. 62-70; also Trabue, M. R. Completion te 
scales Teachers College Contributions to Education No. 77, 1916), pp 


45-6 
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r\ FINAL WEIGHTS IN P. E. OF EACH EXERCISE OF EACH 
TEST. (TO NEAREST TENTH ONLY) 
Tests 
EXERCISE 
I II Ill IV 
1 1.4 1.7 1.1 2.0 
2 1.6 2.7 2.3 1.8 
3 1.8 2.9 | 2.7 3.1 
4 | 82 1361 
6 2.8 30 | 29 | 3.6 
7 | 2.6 3.9 3 3 5.9 
3.1 4.6 3.2 5.7 
9 3.9 3.5 6.0 
10 | 3.5 64 | 34 6.0 
tal 26.0 37.1 27.9 42 6 


Standard scores. 


Standard median scores for late in Feb- 


ruary or early in March taken from 938 papers written by 
rst-year classes in fourteen high schools in five states of the 


West and Middle West, are as follows: 


rest III, 16.9; Test IV, 20.0. 
Values and limitations of the tests —These tests possess both 
tain values and certain limitations; chief among which are: 


VALUES: 


Test I, 16.2; Test II, 


1. The tests provide adequate opportunity for diagnosis 


of weakness. 


2. Opportunity is provided the classroom teacher to check 
the effectiveness of teaching with respect to the va- 
rious types of the four fundamental processes. 

+. Accurate measurement of power is possible because of 
the variety in types of exercises and degrees of 


difficulty. 
LIMITATIONS: 


1. But one or two exercises are included for each subtype 


of operation. 


2. Because of the extended time limits, rate of work 
cannot be adequately measured. 

3. The tests apply only to the four fundamentals of 
elementary algebra as determined by the combined 
judgments of those replying to the questionnaire 


| 
| 
| 
| 
| 
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Pressey, S. L. “Scale of attainment 


3: 389-69, May 1921, complete 


SCALE OF ATTAINMENT NO. FOR MEAS| 
“ESSENTIAL ACHIEVEMENT” IN THE THI} 


LUELI 


ANALYSIS OF THE CURRICULUM OF THE THIRD G 


Reports on two previous “Scales of Attainment” hav 
appeared.' The first of these was an examination for the 
grade, the second for the eighth grade. The idea back 
three of these examinations is essentially the same:—the pun 
of measuring the essential achievement of the grade. On 
subjects as could properly be called “promotion” subject 
been considered, since others, though important from 
standpoint, hardly condition a child’s school progress 
curriculum of the third grade includes spelling, reading, ar 
tic, drawing, singing, and writing. Of these drawing and sir 
are of little importance from the writer’s standpoint sinc 
in these subjects does not affect the progress of a child throug! 
grades. Also, children are not generally retarded because th 
not write well. The fundamental “promotion” subjects 
grade appear then to be spelling, reading, and arithmetic. Ani 
question, In constructing this examination for the third g 
was as to the most desirable form for tests in these three sub}: 

Words for the spelling test could, of course, be obtained 
the Ayres’ scale. The troublesome problem was whether to 
list spelling, a timed sentence spelling test, or some other speci 
form. The construction of a test in silent reading was a 
difficult matter. Under the direction of the writer, a special stud 
was made by the members of a large extension class. It was 
cluded that an ability to read with sufficient understanding 
grasp story values was the most important factor for this 
Children in the third grade should be masters of the techni 
reading to such a degree as to be able to pay attention to the ideas 
presented, provided the material is reasonably simple. The 

Pressey, L. W. “Scale of attainment No 1.—An examination of ac! 

in the second grade,” Journal of Educational Research, 2: 572-81, Septem! 


history, arithmetic, and English in the eighth grade,”’ Journal of Educational Resear 
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sould be able to read short stories with understanding and with a 
ertain grasp of the story as a whole. The point most emphasized 
that the reading matter selected for the test should be coher 
Isolated sentences, bits of incidents, short selections without 
irticular story value, would not give measures of greatest 
to the teacher, since they would not demand of the child that 

e grasp the story 

Measurement in arithmetic remained to be considered. In 
the third grade there is intensive drill in the fundamental opera 
sens. But there is more than this; a real beginning is made in 
volving problems. The children should learn to read a simple 
roblem, interpret it for themselves, and apply the needed process 
so it appeared that both skill in the fundamental operations and 

ility to solve simple problems should be involved in any test of 
hird-grade work in arithmetic. Though the proportion of 

em work to drill in fundamentals varies a great deal from one 
her or from one school to another, all teachers and all schools 
seem to have some work in both fields. 

It was decided that the test in spelling should involve the 
spelling of words in their proper setting in a sentence, that the 
reading test should require the grasping of the meaning of a 

werent story, and that the arithmetic test should involve both 
he fundamental operations and simple problems. Upon the 
hasis of this analysis the scale was built 


THE SCALE AND ITs CONSTRUCTION 


lhe scale appears on a four page folder, each page 9 by 6 
nches. The spelling test— with the lines for name, age, etc.—is on 
the first page. It is so placed because the children cannot know 
what to do on this test until told by the teacher and because study 
i the page in advance by those first receiving their papers is 
therefore of no advantage. The arithmetic test is on the back page 
ind is given immediately after the spelling. The reading test 
«cupies both of the middle sheets, the items being so arranged 
that the one at the end of the first page is continued on the 
second, thus starting the children on the second sheet almost 
without their knowing it 

Directions for the test appear on a single sheet of the same 
size. All the directions, except those for the spelling test, are of 
the “‘question-and-answer’”’ type. since this method has proved 


a 
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more successful with young children than anything more for; 


, Che spelling test requires about five minutes to give; t] 


tic test, seven minutes; and the reading test, eight minutes 
hildren thus work twenty minutes; and the time needed { 
lirections, passing out blanks, etc., makes up a tot 
half an hour for the entire examination 

Scoring of the tests is reasonably simple. The spelling 
takes only about half a minute to rate; the arithmetic test re 
ibout the same amount of time, and the reading test no longer. ]; 
all, it is possible to rate the test and obtain the total score in 
two minutes. A teacher can thus rate the blanks for a clas 
thirty-five in not much more than an hour. The total scor 
the examination consists simply of the sum of the scores or 
three tests 

[HE SPELLING TEs1 


In regard to form, the spelling test is somewhat unusua 
consists of sentences such as the following: 
1 My told me to go 


3. She has a great deal of 
Che teacher explains to the children that each sentence on th 
page has a word left out, and that she will tell them what 
they are to write in. She then reads the sentence as it shou 
tells which word is to be written, and then repeats the w 
sentence. Thus, the directions for the three sentences given above hi 
are 


Look at the first sentence It should be “‘My mother told me to g 
Mother” is the word you should write on the line where it has been left St 


Che next sentence should be “It is very cold in winter.”’ “‘Winter 
the word you should write. “‘It is very cold in winter.” 

rhe next sent e should be “‘She has a great deal of money.” Mone 

e word you should wri “She has a great deal of money.”’ 

By giving the word in its context, the child’s attention is not wor 
entirely centered upon the spelling of the word. Nothing has been 
said about a spelling test, nor is there anything on the pag 
indicate to the children that they are being tested specifically in 
spelling; they are simply to “write in the word that is left out 


Pressey, L. W \ group scale of intelligence for use in the first three grace 
wrnal of Edu nal Psychology, 10: 297-308, September, 1919 
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setting of the spelling problem also gives the children the 
‘+< context without making them write an entire sentence 
»nethod would seem to combine certain of the merits of both 
sentence spelling, since the writing of only one word is 
yet the words are given unmistakably in their context 

he added that the words were selected from the Ayres 


Columns G to Q° 


Ir THe ARITHMETIC TEs1 
rhe arithmetic test represents an attempt to eliminate writing 
e solving of problems since it is ability in arithmetic, not ) 
need of writing, that is being measured.‘ The scheme has been 
pted of asking a question, followed by four answers Only one 
nswer is correct, and the child is to make a mark around it 
sample problems from this test are given below 
6. How muchis&8—3? 6511 24. 
10. How much is 6x 3? 18 12 9 3. 
13. How muchis13+0? 12 11 14 13. 
16. How much is 33+6? 9 39 12 33. 
20. If you bought a bottle of ink for 10c and some candy for 4c, how 
the much would you spendinall? 10¢ 6c l4c 40c. 
24. Doris has 7 books, Frank has 3 times as man) How many has ' 
Frank? 14 21 10 4. 
\s is evident from the type of question it is expected that the 
hildren will do most of the work in their heads. In fact, on the 
ers of over a hundred children recently tested there were only ) 
or three marks in the margins. The first four questions are 
ised as examples; two of these deal with the fundamental com- ) 
hinations and two with simple problems. The children seem to 
[he sentences are not arranged in the order of difficulty of the words to be | 
The reason for this is psychological If the list is in order of difficulty, | 
1 feels that the words are constantly becoming harder He senses that the 
lot worst is vet to come Glancing down his paper, he finds that there are still 10 more 
‘€! he knows that if the words keep on getting harder he will shortly be beyond i 
As a result he becomes discouraged and misses some o! the words he 
it ght really spell if he were not so apprehensive Jt is surely of no particular impor 
since the entire list is given in any case—that the words should appear in any ; 


| order, provided the same order be used for all 
‘ Thorndike, E. L. and Courtis, S. A. “Correction formule for addition tests, 
Teachers College Record, 21: 1-24, January, 1920 
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tind no difficulty with this method of presenting the problem 
In fact, they seem able to work without fatigue for a consider 
longer time than is possible by the usual method of working 
the problems on paper. The saving in time is also of advant 

It seems reasonable, then, to suppose that the form of the t¢ 
is satisfactory. It is very certain that the children like it, it doe 
not have a bad psychological effect upon them, as is the case wit} 
other arithmetic tests with which the writer is acquainted, and 
it appears to be completely applicable to this grade 


READING TES’ st 


Che reading test is more neariy similar to other standard 
ized forms than is the case with the spelling and arithmetic tests 
It has, however, {rom a psychological point of view, one rathe; 
important difference. It is made up of paragraphs each of whi 
relates a fairly coherent story or incident. Following each para 


avi 


graph are four questions. The questions are answered in just th Fr 
same way as with the arithmetic problems; that is, the chi 
selects the correct answer—from four possible ones—by drawin 
a line around it. Being already familiar with this type of respons: 
as exemplified in the test just preceding, the children fin 
difficulty in understanding what they are to do. A sample pas 
sage appears below 

Once a bright star wanted to come down toearth and bea flower 
she might be near little children who would love her. First, she tried being 
a white rose, but the children were afraid of the thorns. Then she tried being 
a daisy, but the children didn’t see her because she was so small. 1 


It will be noticed that the wrong numbers are those which will be obtained il the Stor 
wrong process is used. Thus, in the 20th item presented above, if the child subtract: rea 
or multiplies (he can’t divide) instead of adding, he will obtain either 6 or 4 
answer. Both these numbers appear in the list, so he will not be deterred 
wrong idea for lack of an answer that agrees with it. As faras possible, wrong answer 
have been anticipated in this way 

*In an arithmetic problem test recently devised there are 10 problems 
children (of the third grade) are allowed to work for a half hour on these ten. | 
tainly such a test takes on the character of a measure of endurance. It also 
out, to a very great extent, the element of speed which is of importance 17 
arithmetic. Readiness in grasping a problem, quickness in making the necessa! 
combinations, are surely as essential to real ability in arithmetic as the power ¢ 
problems provided one is given time,—for in real life (for which the school is presut 
ably preparing) one certainly has to make change and perform other simple mathe 
matical operations within a very short time limit 
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em ; in the cliffs and became a dew-drop, but the children could not climb 
rab] _ high. Finally, she lighted softly on the waters of a shallow pond and be 
itiful white water-lily. Then the star was happy because she was 


hildren and they loved her 
it did the star like best to be? rose dew-drop water-lily daisy 
What did the star want to be near? cliffs pond children’ earth 


ae What flower were the children afraid of? rose daisy pansy lily 
Wil Where didthedew-drop grow? pond cliff field lake 
- [his passage should be compared with similar passages from 
ther reading tests for this grade to appreciate the difference in 
story value” between it and those appearing in other tests. The 
selections given below are from various reading tests that employ 
on re or less similar method 
ests ) who lived in a sand-hill was sitting at his door in the sun eating 
(Her ke An ape went by carrying an orange seed 
nich Where did the crab live? 
ra had two brothers who were both tall. Their names were Will and 
he Fr John’s sister, who was short, was named Mary. John liked Fred 
| ter than either of the others All of these children except Will had red 
viz hair. He had brown hair 
= Was John’s sister tall or short? 
‘ How many brothers had John’ 
What was his sister’s name? 
I book is lying on the desk (a picture of a book, face open, is pre 
t above the paragraph), but it is hard to make it stay open. With 
ir pencil draw a single straight line to represent a ruler lying across the 
cing k to hold the pages open. Be sure to make the line from one side to the 
. her, across the book, instead of making it go up and down 


It is the writer’s contention that the above passages have no 
story value. They are simply isolated reading exercises If the 
reading matter of a passage doesn’t tell a story or develop an idea 
what is the use of being able to read it? Such reading mattet 
exists fortunately—for the most part, only in tests. In all 
reading there is usually a story, a description, or an exposi 

some sort of significance. Again, the question of gaining 
Cer the interest of the children is a vital one. Surely no child could 
interested in such selections as those given above. 1 hey 

start anywhere, and they don't arrive anywhere, and they 


& iren't about anything: indeed, it would take a statistician to 
lentify correctly the family described in the se¢ md passage 
‘ re is a distinct movement now on foot to give children in 


iding matter that there appears to be some interest In 


ive eal 
Les! 
Bk 
| 
} 
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reading; such tests as the above are certainly not in the spiri: am 


this movement. Incidentally, there is considerable doubt 
whether the ability to gain a coherent idea of the passage read 
at all tested by these tests. They would seem rather | 

type of mental alertness 


RESULTS AND FirsT NORMS 


Che separate tests of the scale were first tried out by teache; 
in university extension classes. From these results, items wer 
selected and a trial form of the scale printed. This trial form was 


given as part of a survey of Bedford, Indiana.? The r 
showed the need of certain revisions which were according|y mac 
in the tinal form which is now ready for distribution. Sing 


making the final form the following tentative norms ha 
obtained (October testing): 


Median No. Case 


Spelling 12 198 
\rithmeti 9 198 
Reading 11 198 
Total Score 10 198 

lhe writer has done very little in the way of validation ot the 


scale. But the test most in need of validation has perhaps been 
sufficiently investigated. Several teachers have been as t 
make ratings of their pupils as to their ability to read with unde 
standing. Correlations of the reading test results with thes 
ings vary from +0.60 to +0.82. This would seem to atiord 
siderable evidence that the test is really measuring the abilit 
the children to comprehend what they read 

About the spelling test, there can be little question. | 
in the third grade do little in the way of using spelling as a tool in 
writing. Accordingly, sentence spelling would hardly be appl 


ble to the grade. The present test is presumably at least as gooc gon 
Che writer wishes to express her indebtedness to Superintendent E WM 
gomery of Bedford, Indiana, for his cooperation in this and many other prot 
* The blanks may be obtained in quantities from the Department ot | c ' 


Indiana University at $0.90 per 100 tC 


Norms (October 
| 
write 
n te 
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sure of spelling ability as list spelling—and it avoids some of 
‘ectionable features of the latter. There might be some 
| about the arithmetic test. There is surely little differ- 
‘ween the material used in the test and that used in the 
n; any difficulty would be with the method of indicat- 
answers. Since no child has yet made a zero score on 


t the method of indication would not seem to be so difh 
to interfere seriously with the solution of the problem 


FUNDAMENTAL FACTORS CONCERNED WITH TES1 


BUILDING 
conclusion, the writer would like to point out one or two 
fundamental aspects of testing and of test construction in 
ified in this scale, but 


mentary grades which are exemplifies 
should appear in all scales for use in these early grades 
haps in the upper grades as well. 

One of these fundamental points is the matter of motiva- 
[he writer feels sure that motivation by interest is the 
sonable, indeed the only possible, way with young chil- 
\ test that relies upon school discipline for its motivation 
but be unsound from a psychological standpoint. A mo- 

n coming from interest vitalizes the test situation as 
+ else can, and should be sought after wherever possible 
[he participation of the teachers themselves in the making 

test, and in the selection of the materials for it, is of great 
rtance. They are intimately in touch with the teaching 
tion. The test builder sometimes, to judge from his tests, is 

[here are at present many scales on the market that are 

rightly condemned by teachers, because they are not closely in 

h with the teaching, or are not adapted to the children, or are 

fitted for use by the teachers. In the present instance, the 
writer has contributed little save the method of presenting the 
material and the technical part of test construction. The rest is 

e result of the study and observation of competent teachers 
n test making. A much greater participation of those who are 
going to use the tests is to be hoped for. 

3. Achievement tests in “battery” form are now becoming 
popular. In such an instrument, tests in more than one subject are 
included. Under such circumstances, it is easy for an examination 
to become elaborate and cumbersome. The manuals of directions 
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The method pursued was substantially that used by Wise: 
and Monroe? in their studies of arithmetic problems. Th 
le material presented in each book was divided into 
SSeS 1) examples, i.e., drill and test work, in whi 
rations to be performed were indicated for the pupil 
ns, or work in which the method of solution was not 
indicated. To make the results as nearly comparable as p 
each separate example or problem was counted as a unit. eve; 
though the author had included several such in a singel 
fables of numbers, from which the teacher or the pupil could 
an almost limitless series of examples, were omitted in th 
fication 
Examples and problems were then classified separately 
the arithmetical operations or combinations of operatio 
volved in each, including the use of fractions. Where fracti 
numbers were employed merely to indicate division (as ! 


etc.) the examples and problems were classified under “‘Divisi 


classification as “Fractions” being restricted to examples 
problems using fractions as such. 

Problems were further classified (1) as to general sul 
matter, according to a modification of the scheme adopt: 


Monroe, and (2) as to the use of measurements and the typ 
measurements employed. 

[he totals of examples and problems found in the six |} 
with the proportions of each, are presented in Table | 
noteworthy that the totals vary from 1777 (Chadsey-Smit! 
3106 (Wentworth-Smith)—a range of nearly 1400. Ther 
been little standardization, apparently, of the amount of n 
to be covered in this grade. Wide variation is also evident in 
proportions of examples and problems presented. There w 
seem to be a tendency, however, toward a greater proportion 
problems in the more recent books—a hopeful sign (assuming | 
the problems are of the right type), in view of the present emp! 
on the need for making schoolwork vital and cgncrete, rather t! 
abstract. 


' Wise, C. T., “A survey of arithmetical problems arising in various oc 
Elementary School Journal, 20: 118-36, October, 1919. 

* Monroe, W. S., “A preliminary report of an investigation of the ecor 
time in arithmetic.” Sixteenth Yearbook of the National Society for the Study 


cation, Part I, chapter 7. 
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I. NUMBERS AND PROPORTIONS OF PROBLEMS AND EXAMPLES 
CONTAINED IN SIX THIRD-GRADI ARITHMETICS 


NUMBER PERCENT 
Texts 
Examples | Problems | Total |! samples |Problems 
Millis (1920 1.526 751 2277 67 330 
y-Smith (1917 1,334 443 1777 75.1 249 
1915 1.887 667 2554 739 26.1 
Suzzallo (1914 2.513 582 812 188 
rth-Smith (1911 2,344 762 3106 75.5 245 
1906 2.059 442 2501 823 177 
rag 1,944 608 2552 762 23.8 


lable II shows the distribution of examples according to the 
types of operations involved. With the exception of Milne, the 
books are practically agreed in requiring the use of a single one of 
the four fundamental operations in the solution of over 90 percent 
i the examples and of more than 85 percent of the problems—a 
practice supported by the findings of Wise in his study of prob- 
ms taken from everyday experience. But in the relative amount 
of space devoted to each of the four single operations the books 
vary widely—so widely that the median is of little value as an 
indication of general practice. Here again practice has apparently 
been determined in each case by the arbitrary judgment of the 
textbook maker, rather than by reference to any sort of objective 
standard. 
The variation in proportionate emphasis on the fundamentals 
between examples and problems within the same book is as worthy 
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principles established by Wise’s study. Their weakn 
pedagogical method, rather than in aim; they show no 
of established standards as to the amount of practic 


master the fundamentals. 

In the classification of the subject-matter of the 
(Tables III, IV, and V), we find a basis for determining 
to which the texts meet the present and the future 
interests of the pupils who use them. Here again a ver 
diversity is apparent. Of particular significance is the vari 


the proportion of problems which relate to no human acti 
such problems as, ‘“‘How many feet have 16 birds?” or “A 
cost $134. How much more than $1]4 is that?” The H 
Peet Everyday Arithmetic is the only one which has a ck 

in this respect; the Walsh-Suzzallo text is the worst offende: 
4.1 percent of its problems (24 in all) of this worthless type 
tabulation shows an encouraging tendency, however, toward 1 
elimination of this sort of work from the later books. 

There is a much larger group of problems (49.6 percent 
those in the Wentworth-Smith book) which give valuablk 
tice to the pupil and are of a sort which he will frequently 
but which as presented can be identified with no par 
activity. Of this type are such problems as, ‘“‘How many pec! 
there in 8 bushels?” or, “What is the perimeter of a lot 18! 
square?” In their lack of appeal to the pupil and their la 
connection with concrete activity, they are of much less valu: 
course, than problems which possess definite significance. As | 
the problems relating to no activity, the proportion of such pr 
lems seems to be decreasing in the more recently published b 

With the exception of Wentworth-Smith the books are fai 
agreed in devoting about half their problems to Home Activit 
Personal Activities, and the Activities of Children. Five books 
of the six agree in relating about 10 percent of their problen 
Home Activities; in the other two classifications just mention: 
there is considerable divergence. Within all of these fields 
quality of the problems presented counts for so much that wit! 

a more exact classification than that of the present study, a: 
without more definite standards of evaluation than have yet | 
developed, we can draw no worth-while conclusions as to present 


tendencies and limitations. 
For the distribution of problems dealing with occupations w 
have standards of a sort. If we consider these problems in the 


40 


ALIAIIOY 
ON OL ONILVIZY 


< 


Stone-Mi 


eu 
sia 
= 
= x > las 
< AMLSQGN] 
= 
= 1 
= 
I x 
e 
= < " 
4 
2 
i = => = < | | 


q 
= { 
by 
ht not mere present ne le 
moter ol ti it or tiona ni 
I 
‘ sin re ¢ 
‘ Ol CS | ) ( ) 
‘ } ¢ har ¢] ry . ti 
i 
interests ctivities ne conc e thou 
ment ol ro ( to the Varlous ¢ 
problet represented in each group The thre 
DOOKS ord problems under a 1x occun 
the earher texts tend serlmousiy to ne ect \ l 
TABI COMPARISO> THE DIST UTIO 
rH! Kl G POPULATION O} LUNI ) 
- 
Sons 1 ye ; 
‘ ‘4 
Wer | ( 
Milt 100.0' 12.4) 5 11.2 15 
‘ 


{ 
s = 
es 
I 

- | 5 

| 

— 

- Pi 

aNXv’] 

many 
. = 
: 
= 
= 
= 

4 

_ 
| 
| 
~Unmssae 
x 


422 JOURNAL EDUCATIONAL RESEARCH | 


notably Agriculture and Industry (Wentworth-Smith and 

lransportation (Wentworth-Smith), and Public Servi 
Suzzallo and Wentworth-Smith). The second point i 

” by an inspection of Table IV, in which the percents of ox 

“. problems belonging to each group are presented for | 

; with the distribution of workers by vocations according 
census of 1910 (adapted from Monroe). Though the distri 
of problems diverges to a considerable extent from t] 
industrial population, there is yet evident in the later b 

; degree of approach to this standard distribution. 1 

: emphasis on trade is not a serious defect, since this is an 


tion with which every adult (and nearly every child) | 
less to do. The most serious neglect appears in the field of j 
try, which, though claiming nearly 28 percent of th 
workers, is represented at most by but 5 percent of the p! 
Our final analysis is concerned with the number of 1 
ment problems and with the types of measurement in 
fable V). With but one exception Chadsey-Smith), t! 
textbooks are fairly agreed in devoting about one-fourth of 1 
problems to some type of measurement. Beyond this point 
ment ceases. There is a tendency in the later books to p 
study of certain forms of measurement (notably square and 
measure), taken up in detail in the earlier published text 
in the amount of space devoted to the remaining forms of 1 
ment (linear, dry, liquid, weight, and time) the books 
widely at variance. There is here very evident need oi 
irdization of the course of study on the basis both of pedagog 


and of utilitarian values 


SUMMARY 


Uhe very limited number of texts involved in the pr 
study makes the drawing of general conclusions a danger: 
ceeding. Until such time as a more extensive investigati 
possible, however, the following conclusions are advance 
what they are worth. 

1. There is much need for standardization of third 
arithmetic texts: (a) as to the nature and amount of 
presented for study in the course of the year; (b) as 
emphasis placed on each of the fundamental operations; 


as to the subject-matter of the problems presented for soluti 


a. Fs \ 
+ 
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Present practice in textbook writing apparently tends 
concentration of attention in the third grade on the 
ntal operations of arithmetic, with a postponement of 

y of fractions to the upper grades—a tendency the value 
h is supported by the findings of Wise and of others with 
to the utility of these phases of arithmetic in practical 


here is evident also a tendency toward greater emphasis 


iem-solving, in contrast to the simple “doing examples”’ 
irlier books. 
\ study of the subject-matter of problems shows an in 
- elimination of those which relate to no human ac tivity 
-h can be identified with no activity and, as a corollary, 
rease in the proportion of worth-while, intelligible problems 
rextbook makers are apparently coming to appreciate 


eed for making their problems representative of the fields of 


in which pupils are likely to be engaged 
Movement in all these directions toward better third 


e teaching material is as yet, however, ill defined and irregular, 


¢ on no firm basis of educational theory. The pressing need 


e present time is for a pedagogically sound definition of 
netic material (a) in terms of the amount needed to accom- 


most economically the desired results, and (b) in terms of 
t-matter looking not alone to efficient mastery of the funda- 


ls but to the proper development of the whole child. Until 


sve such a definition, the making of textbooks in arithmetic 


be (as it has been in the past) guesswork, pure and simple 
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tens, of health service, the household arts, and the like 
tion in these days of retrenchment would be much mor 
here is likewise need for a most careful scrutiny of th 
employed in financing building programs throughout th 
States. Large expenditures are being undertaken in s 
without an adequate study of increases and shifts in p 
within the area to be served; and in some cases extravagan 
been permitted in the construction of school buildings 


could not possibly be justified were the program of capital ex] 
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given another form of the test. He is excused from further woe, 
in addition of fractions when he attains a consistent), : 
score on one of these tests. Here we have curriculum 
diagnosis, individual instruction, and tested results—all organ; 
in a highly satisfactory manner. Yet the teacher must remaj; 
unfamiliar with this admirable presentation because it d , 
appear in a book. 

At the risk of being tedious we shall give another inst 
Doctor Luella M. Pressey s suggestive article in the September 
1920 number must remain unknown to the vast majority 
teachers who could use it. Yet in this article Doctor Pres 
only adds an important test to those already available (a: 
when we needed it, too), but she also sets forth a method by 
the teacher may construct home-made objective tests of her 


At some future time the book writer—whose service consists for 


the most part in collecting other people’s ideas, and who 
contribution may be his particular juxtaposition of ther 
no doubt have something to say about this test. He may ev 
refer to Doctor Pressey’s article. But it is certain that his write-y 
will lack the directness, the force, and the vividness of the origi: 
Moreover, it will be late in arriving upon the scene. If an idea i 
worth using, it is worth using now. 

The worth of these ideas does not depend upon their appea 
ance in a bound book. What Rochester is doing in rea 


(O’Hern and Hawley), what Boston is doing in geography (Bar 
thelmess), what St. Louis is doing in penmanship (Walker 
the Pacific coast school is doing with intelligence tests (Terman 


Proctor, Dickson)—these are among the things which wid 
awake teachers want to know and which wide-awake superintend 
ents want their teachers to know. 


Why, then, may not subscriptions to periodicals or sing! 


numbers of periodicals be included in the material which teachers 


are encouraged or expected to read? Why this predilection | 


r 


books? In our judgment there is in any one of a half dozen maga- 


zines more timely and stimulating educational writing than can 


be found in any but the most unusual book. 
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however, the dropping 


themselves 

this impression 
nstructing the scales both the method originally employed by Hillegas and 
ntv Supplement vere 


the method used by Trabue in deriving the Nassau Co 
f the ape imens ol 


for the latter differ on the average | 


\ somewhat detailed examination social letters and 


shows that the two sets of values 
r about 1/32 of the length of the scale, while for the former the avera 
is only 0.17 of a step For the specimens of social letters the positive and 
lifferences appear in small groups; in the narra 
ct that the very small differ 


tion specimens they appear 


This seems to be due to the fa 


large vr Ups 
the specimens were added together to get the total scale length, whereas In 
11 scale larger and hence more reliable differences were added together. A 
errors entering in this way seem to account for the larger lifference between 
sets of values in the narration specimens 
by the shorter method of having the 


view of this condition the values obta ned by the s 
ns graded is probably more accurate than those obtained 
} rior ly +} } 


The work of the author in 


the much more 
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ed process 
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1s been further substantiated 
by competent judges with a scale has definitely established the possibility ol 
ning various extensions of the original scale and of securing steps at equ il inter- 
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Hertzoc, W. S. State maintenance for teachers in training. Baltimore 
York, Inc., 1921. 144 pp 
The author, at the outset, portravs with desirable emphasis the f 
importance of relieving the teaching profession of an unfavorahle social 
the necessity of affording substantial economic relief to competent m« 
profe n. This is not new; but until these cardinal defects are reme 
profe mn will continue to occupy a position of inferiority with respect 
fe ns and with respect to the industries 
Among the purposes laid down in this volume are the following 
gate teacher-shortage and to record the best re'ief measures employed in s« 
b) to investigate the principles, problems, and practices involved in a 
es for prospective teachers as one method of recruiting the prof 
rposes are detailed, (a) by a survey of conditions which revea! an imper 


for financial support to teac' ers in training, (b) by a review of e 


ind in the United States to recruit the profession by means 
prospective teachers, and (c) by drawing lessons from other professions ar 


tries in their attempt to win recruits by means of financial assistance 


The author ludes that a policy of sul es, following the prin 
tices which obtain in the recognized professions, would contribute sul 
relief of the existing teacher-shortage and would in large measure raise 
out of the sl f social inferiority The volume merits a careful 
th e wl e vitall oncerned with teacher-tra n ind by s ] 
e been far t lulgent in accepting the ‘finished product 
teacher train iwenc’es 


Your reviewer would have welcomed a discussion of the significance of 


shortave as an opportunity on the part of school administrators to impre 


with the dangers involved in an inadequate supply of well-trained teacher 


administrators appear reluctant to place the responsibility for a shortage of 


teachers where it belongs, namely, on the public. They have lowered star 
mace pos le the er oyment of thousands of untrained and incom é 


Report has it that 48 percent of the teachers in one state of our glorious I 
had no training bevond the eighth grade, and that 68 percent have receive 
a high-school education. If state laws permit this disgraceful condition, t 
remed\ the establishment of standards. In states maintaining desirable 
the practice has been to lower them Such practice re luces the shortage 


the gates to incompetents, and accustoms an undiscriminating public to a lo 


enforcement of standards entailing consequences for 


public should be held responsible. So long as school administrators are 


place the responsibility on the public, where it rightfully belongs. but are 


employ incompetents in periods of teacher-shortage, so long will the profes 


economic servitude and occupy a position of social inferiority. 


GEORGI 


e more wholesome to the profession and more benefi 


tea ng 
Nothing could 
nation than a rigid [ee 
Ohio State University 
. 
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LAWRENCE Avucustus. Psychology for norm ul schools, (Riverside Textbooks 


cation). New York: Houghton Mifflin Company, 1921. 362 pp. 
nately for the training of teachers, mere contact yurses in education, 


it they are, is in many quarters st ll supp isly to give pro- 


reparation for teaching. Legal requirements for certificat ofte 
ertain number of hours in psychology an 1 education, regard] f whether 
serve a specific prac tical purpose or meet specific needs Si text 
ation are like the old time physician’s shot-gun prescriptions, being 
suitable for college or normal school classes or for teachers r ading circles 


hat is suitable for groups so diverse in prepara 


ot good for much 


or Averill’s book has the merit of being designed for a specific grouj 
t does the title Psychology for Normal Sch It is not a text in educational 
but in general psychology, though it includes much yf what is ordinarily 
educational or genetic psychology. On the other hand, it differs very 1 h 
rdinary text in general psychology The first one hundred and forty-three 
» twenty-one lessons out of forty-six, are given to a de tailed discussion of 

nd emotional behavior, followed by forty-five pag x lessons) on heredity 
th little in them but a doubtful complete list of sensations 


gets seven pages V 


mages on the earliest sensations of infancy. Six pages dispose of perception, 
e whole subject of the perception of space and time gets twenty lines. Memory 
ed in one lesson of six pages without a word about the laws of learning which 
mirably presented in such a book, for exam] le, as Pillsbury’s Essentials of 


One lesson likewise disposes of such an important topic as thinking and 
g 


+ of the will and moral development. The remaining lessons deal with the juve- 


ruent, the subnormal child, the gifted « hild. individual difference, the unstable 


lescence, and the evolution of t 
it psychology is of most worth fc 


That the type o! psychok 
hools as better tl 


Lile 


holacy 


tr 


he social attitude toward children 


teachers is a qi 


present 


the conventional type the reviewer doub 


lestion 


ed in this book 


that will be variously 


1 ‘mu 


man 


lent would complete the course outlined with very little notion of what modern 
logy is and without and appreciation of the complexities of mental processes 
es it appear that he would be better prepare ifor teaching by it. Surely to give 

n to a discussion of the food-getting and hunting responses an 1only one each 
topics as sensation, memory, and thinking is out of all proportion 


A. C. HENMON 


f Wisconsin 


iSON, New York: Macmillan Company, 


1971 


Joun Atrorp. Project of teaching. 


xvi-+ 305 pp. 
This book is a valuable addition to the growing literature which attempts a syste- 

examination of the proper definition of the term “Project”; and a constructive, 
zh critical, evaluation of the project method as a practical instrument for school 

loo much of what has been written on this topic either takes the form of propa- 
la or is so theoretical that it has little stimulation for the average s« hool man or 
Both of these weaknesses are avoided by Doctor Stevenson. 
ved are, in general, put clearly and fairly, and are made concrete by considerable 


The issues 


é 
‘ 
| 

; 

oh 

' 

* 

uccepted for Pr 

; 

| 

ga 
inv 


f 
will probably raise one or more of the following obje tions to the treatme 


pr t as fo 
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ion. The book should be welcome, therefore. as a text eve 


ild object to certain of the author's conclusions. Those wh 


osely the development of educational practice in the last twe 


na +} } 


[ found in this book 

1) The four standards set up by Stevenson must not be regarded, by 
as standards for judging teaching in general, but only as standards for 
teachi Some will feel, moreover, that these standards do not represent 
dige f present and past opinion regarding the project, but rather t 
cl e of certain elements among these opinions. Such a selection is. of 
fable, but the reader must keep in mind that such a choice has been mack 

?) The book should have contained a section treating the practic 
which the teaching public has thought of as employing the project method. | 
there should have been a critical review of the work of Booker T. Wa 
luskegee; of Dewey, at Chicago; of Miss Cooke, at Francis Parker; of | 
Speyer School; and of Meriam, at Missouri. Possibly, too, some of the mor 


schools—such as that of Miss Johnson at Fairhope—should have beer 


In r nany readers will doubtless feel that there has been tox 
given to t e who have written about the project, to the neglect of thoss 
contributed in practice to the development of the various technics involved 

3) The various issues involved should have been made clear by a caref 
of the ef theories which have been prominent in the last quarter of a cent 


tion wi 
W 


contusion 


eories which have gone under the following names: Her 
pragmatism, reaction psychology, and the prol 


ounded by Dewey. No doubt the author was led to omit the dis: 


pt the last, on account of the difficulty of presenting a clear 


its of a book of the character of this one 


distinction between the psychology of thinking and the p 


made sufficiently clear. Most of the mistakes which have beer 
th the 


problem method and the project method may be trac 


e learn, to be sure, while thinking, but this is not the onl 


the most economical method of learning 


Some of 


+} > } 


ese objections are referred to, or touched upon, in var 


throughout the book. No doubt with more time and space, all of them 


been more ac 


The auth 


by the recent 


consistent avoidance in his illustrations and discussions of the sentimentalitie 


‘ly discussed 
r is to be especially congratulated on his steady refusal to be | 


lasis on the more subjective aspects of the project; ar 


too much of our recent literature abounds. He is not seeking a method wl 


riously develops certain subtle and general qualities. He seeks a meth 


which plain o 


} 


yjectives in the form of special abilities of known value ma 


economically reached. He is undoubtedly right in his statement that “the 


for the natural setting of the teaching situation is the distinct contril 


} 


project method.” In fact, the elaboration of this idea is the chief contribut 


book. 


Ernest H 


State University of Iowa 
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nex, Davip. Sociological determination of objectives in education Philadelphia: 


B. Lippincott Company, 1921. 322 pp 
thic hook Doctor Snedden takes the position that ectives of education | 
e determined, in the main, by data ar d method l] within the field of | 
In order to equip the youth for the bu ness of liviz t is necessary to fur . 
ng for the various occupations of adult life. Such training must be directed 
of a sociolog al sort Moreover, sock ke gy can It rl sas to the value or 


f educational subject matter which has no direct bearing on vocation. “By 


ation of suitable sociological methods,” for example, “it is entirely practi able : 
ver the scope and character of mathematical knowledge now used in any given 

of living’ class or group, and, on the basis of the facts thus found and evalu 
to propose necessary OF desirable improvements in processes \ { instruction and 

to be applied to the rising generation” (p. 33 

Doctor Snedden’s exposition, this doctrine 1s linked up with the distinction 
values of production’ and ‘values of consun ’ The former values have 
vocation, and hence the standard is set by und demands of society 

er. on the other hand, “center definitely in cultivation of spe pe nal. ' 


tual, and aesthetic interests the resources wherewith 


r individual lives They should at least establish abiding « iltural inter- 
preciations, tastes, enthusiasms, even hobbies—in literature, science, foreign , 
ges, and history p. 83). This distinction in values points to a corre g : 
n in educational subjects or courses. One group, labelled “‘A class” subjects i 
lead very directly to processes and capacities known to be of use to the indi : 
n adult life, or to the society of which he shall be a part” (p. /0 The second : 
alled “B class” subjects, “are those primarily which we follow, and to the i 
es only which we follow them, because of innate and easily stimulated desire / 
The subjects in the former group are " hard”; they are properly imposed only : 
e of obvious usefulness, and they are character zed by rigid method and by 
| tasks which are aimed at doing, at facility of expression in action The s : 
f the latter group, on the contrary, are directed rather towards absorption, or : 
ition (p. 49), and so they partake more of the nature ol high-grade play ’ 
It is this distinction between values of production and values of consumption : 
nstitutes the basic principle of Doctor Snedden’s philosophy of ed 
m this distinction he deduces the classification of s ibject matter into “A cla 
s and “B class” subjects, and also the further contrast between hard work or : 


The former aims at “expression in action, while the 


and “high-grade play.” 
er is directed towards “assimilation” or “absorption.” It is rather curious to 

that in this exposition practically no account is taken of tl it cor lerable body of | 


that all Knowing Is 


ent psychology which converges upon the conclusion 
tion in question. The trend of 


which, accordingly, would repudiate the distin 


r Snedden’s doctrine at this point is not forward, but backward, toward the ’ 

kean conception of the mind as just a wax tablet or sheet of white paper, upon : 
h the environment may write what it will. Perhaps his position is defensible, but | 


the psychology which underlies it has been too mu h under fire of late years to be 
ps) g) 
taken for granted without argument. 
But this is not the only point at which Dr. Snedden leans heavily upon a du 
1 or cultural subjects 


tradition. His distinction between vocational and non-vocational 
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is another instance of the same thing. The distinction is plausible only as | 
assume the validity of the historic opposition between vocation and culture 
or emphasis Doctor Snedden’s doctrine does not differ materially from t! 
notion that business or vocation is a thing quite apart from the nurtur 
rhe distinction presumably has a certain validity if we think of culture 
main, a private or subjective affair, in that it is directed towards the 
detached, inner appreciations, which have no significant connections wit} 


affairs. If we accept Dewey's definition of culture as “the capacity for 


expanding in range and accuracy, one’s perception of meanings,” the op; 


appears and 


with it the hard and fast classification of subject matter int 
subjects and ‘‘B class’’ subjects. The efficacy of a plumber, for example 

in part, no doubt, by his training in the specific activities that constitute 
but only in part. It is likewise determined by his conception of the relation t! 
obtain between employer and employee, by his standards of honesty, by 
appreciation, in short by his ability to see the meaning of his vocation thru it 
with a wide social context. To classify subjects offhand as vocational or non-\ 
is to encourage the spirit of narrow vocationalism and to give aid and 
exponents of an equally narrow and abstract “‘culture,” against which Doct 

so emphatically registers his opposition. 

One further point should be noted. For the determination of educat 
tives, the subjec t of soc iology is, to Doctor Snedden, as the cloud by day and t 
of fire by night. As far as vocational subjects are concerned, this view 
enough, provided that we take the meaning of vocation in a sufficiently nart 
Taken in this way, we can ascertain what is required for a given vocation as « 
and impersonally as we can determine the constitution of water or calculat 
tance from the earth to the moon. But if we conceive of vocational trainir 
thing more than fitting a man to a groove, so that he can go through life wit 
mum of intelligence, the matter takes on a different aspect. Doctor Snedde 
implies this when he says, in connection with non-vocational subjects, that the 
lum must be constructed “‘on the basis of the facts thus found and evalua 
significance of the evaluating evidently escapes his attention. He seems t 
granted that the evaluation of a more or less incidental task, which sociology is « 
willing to take off our hands and thus relieve us of all responsibility in the ma 

Given the same sociological method, there would presumably be no dill: 
the objectives of such men as Bismarck and Lincoln. Doctor Snedden gives 1 
that the « 
of prospecting for oil or coal. To be sure, the objectives are not supposed to be 


letermination of objectives differs in any important respect from the 


around in obscure places, waiting to be discovered, but there are facts to be dis 
and these facts, when brought to light, decide the question of objectives. P¢ 
this too may be conceded. But can we assume that different individuals will 
the same method? Are we, or are we not, obliged to make allowance for a | 
factor which somehow falls outside the field in which the sciences ply the 
and which, because it tips the balance in favor of accepting certain facts as fact 
the last word in the determination of objectives? 

This does not mean, of course, that the selection of objectives is to be left 
dom choice or caprice. But it does mean that the adoption of a gospel of br 
love, of caring for the weak and of subordinating personal interests to group inter 
or the adoption of any other gospel, involves certain factors which inevitably intro 


“4 

ice 
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| differences. Different men are bound to attach different meanings to the 


of freedom and responsibility, and to the desirability of cultivating an 


road tolerance and sympathetic understanding, which means that they 


to report differently upon the facts of experience. No scientific method, 
1s, can provide an escape from these individual differences. The only / 

k that can be applied lies in the organization of the facts which we happen 

e into a coherent system, which then constitutes our philosophy of life 
n occasion, becomes the basis for our determination of the objectives of 

It is simply self-deception to assume that in the determination of objectives 
tigator can keep his deepest, nonscientific self out of the situation. To make 
sumption is scientific method gone mad. 


easy to understand the present-day reaction against philosophy in its relation 


itute f the 
Lute for Lne 


n. In the past philosophy has served only too often as a substi 


accumulation of fact by which educational theory and practice must be t 
ind directed. Perhaps Doctor Snedden is right when he says that “the philos : 
not, of course, be very patient of these attempts thus to consider democracy 

’ (p. 290). If I may trust my own observation, however, he is less dis ' 
e irritated by analysis than by the lack of it. The classification of values ' 

i by Doctor Snedden, the contrast between expression and absorption, and the 


n between work and play, are all sadly lacking in serious analysis. They are 
ptions that have had a long and evil history, and their weaknesses have been 
it on many occasions and by many critics. Instead of substituting a more 


analysis, Doctor Snedden revamps these old conceptions and ofiers us a 


* 


able philosophy of education, thinly disguised as sociology. I am glad of the 


nity to express my sincere admiration for the clearness and suggestiveness of 
dden’s exposition; but ] find myself wholly unable to agree with him as to the 


f his method and of his conclusions. B. H. Bove 


University 


News Items and Communications 


This department wil] contain news items regarding research workers 
| and their activities. It will also serve as a clearing house for more forma! 
| communications on similar topics, preferably of not more than five hundred 

words. ‘These communications will be printed over the signatures of the 
| authors. 


According to Assistant Superintendent W. F. Webster, Minneapolis is about to 

establish a Bureau of Research. It is evident, however, that without a bureau organi- 

zation Minneapolis has already been doing some of the work which a 

Something bureau ordinarily undertakes. Readers will be interested, for example, 

from in Superintendent Welster’s article in the current number of “The p 

Minneapolis League Scrip.” It is entitled “A Statistical Story.” The author has at 
his disposal the records of pupils admitted to each of the various grades 


3 
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for the past twenty years. His opportunity to study elimination is there 


It is not often true that reliable educational data are availab r histor 

When, as in this case, the data include not only enrollments but numbe 

I ers promoted, and facts as to cost, the opportunity for significant re , \ P 
0 > Dut 


President H. A. Brown of the Oshkosh Normal! School is evident 
because the light of investigation is not being turned on problems of tea 
often or as fully as it should be. We agree with him. Ar 
Research in can be done in the selection and training of teachers is done 
Teacher foca! point of our educational enterprise. It is certain that 
Training of teachers is a topic on which no one can be dogmat 

diversity of the types and amounts of training indicates 
agreement. There must be best ways in which teachers may be trained 


of teacher training is a promising one and we feel sure that any research 


enters it will feel amply repaid for having done so 


We are receiving a number of letters and reports which indicate that « 


research is being applied to higher educational institutions. There is ¢ Bu. 
why this should be so. The problems are scarcely les Su 
Research in that they are with reference to elementary and secondary « Bu 
Higher rhe treatment of these problems, however, has hitherto he 
Education characterized by prejudice and an absence of objectivity. It 
especially true that the Bureaus of Fducational Research 
been established in universities are being called upon to turn their attent 
condition of the institutions to which they belong. Perhaps research 
may well begin at home - 


A recent correspondent raises the question of what is being done 


schools to encourage teachers to pursue advanced work subsequent to gra 
a college or university. In other words, the question ts 
Graduate Work possible for a teacher who has received training addit 
and Salary required for the baccalaureate degree to receive a his 
Schedules more rapid promotion, than the teacher who has not 


tional training. We shall be glad to receive informatior 
whose salary schedules or whose regulations concerning promotion take int 


the question of graduate work. It is our belief that account should be taker 


Miss Velda Bamesberger, Director of the Department of Educationa 


at Okmulgee, Oklahoma, has an organization which seems well adapted 


schools of a moderate sized city. Her department consis 


The Department full-time people—a psychologist, a general assistant, a! 
at Okmulgee It is surprising how much a well-organized department 


can do if it succeeds in enlisting the support of the teacher 


Bamesberger has apparently done. She says ina recent letter: “I have beet 


a great deal of my time to devising records, etc., for the system, and have 


pletely classified the seventh and eighth grades on the basis of intelliger 
educational tests, and school marks. Our recent educational tests sh¢ : 
classification is working well, and the high-school principal and teachers are 

a 


pleased with it.” 


NEWS ITEMS AND © OMMUNICATIONS 


er number of the Detroit Educational Bul 
Superintendent Frank ¢ ody of the Detroit p 
vigorous plea to his teachers to Join the Nati 
\ Professional tion After reviewing clearly and concisely tl 
Duty place in the last four years in the put lic attitu 


general and toward teachers in particular, he shows 


hrought about through the work of the National Associatior 


+ that only if every teacher is solidly behind the N.I 
e leadership necessary to secure adequate public sup] 
for the still better schools of tomorrow 
rticle is illustrated (if this term is properly 
rew Carnegie, which is printed in bold face 
erson up a ladder unless he is willing to climb a litt 
erintendent J. R. Patterson of Bucyrus, Ohio, has sent 
survey bulletins which we have received. It is number 
; series. Superintendent Patterson has been conducting a cycle 
surveys—tall, mid-year, and spring, during the past two years; 
Bucyrus present bulletin gives data on the contents of the program. The | 
Survey _ is designed for the information ol his teaching and supervisory 
Bulletin disseminate survey notions among local citizens and interested fellow work 
ers elsewhere. The contents reveal explanatory notes on statistics sufh 
enable the teacher, untrained in this line, to understand the meaning of the 
-ed in the body of the discussion 
e report of children’s abilities involves column spelling from the Ayre 
scale, Courtis, Woody-McCall, and Monroe arithmetic, English Comp 
reading, and hand-writing scored by the Ayres scale. There is also a sect 
de conditions. It is unfortunate that, like so many others, Superintendent 
confuses retardation with overageness and acceleration with underageness, 
his final statement to his last chart reveals the fact that he recognizes the real 
f an age-grade table. 
ope that Superintendent Patterson will favor us with a copy ol 
Vol. III, No. 2 when he completes it. We shall look forward 
results contained therein and the treatment of the data whi 
There has also come to us a Survey Bulletin from th 
the use of standardized tests during the second 
The testing program here was somewhat more ambitious than the one at 
Another Bucyrus, since general intelligence tests as well as achievement tests were 
Survey used, and the measurement of achievement involved a larger number of 
Bulletin subjects. The subjects in which measurement was made were spelling, 
writing, arithmetic, composition, silent reading, geography, history, music, 
Grst-vear algebra, second-year geometry, and third-year physics. 

The bulletin, like the one previously des ribed, includes numerous tables and 
graphs together with pointed comments on the scores and on the remedial measure 
vhich will be undertaken. 

We have just received from W. H. Pillsbury of the Buffalo (N. Y.) city s hools, 
a mimeographed copy of the “Buffalo Teachers’ Library.” This not only lists what 


: 
{ 
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Education Associa 
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was thought by the committee of Buffalo teachers and a 
— The Buffalo to be the best books and magazines for the teacher 
Pa Teachers’ brief review of each book \ sentence or two whi 
| Library problem and method of attack makes the list more 
name of the book alone. The material has been « 
/ following heads a) general reading; (b) elementary sul yects; (Cc) se 
/ (d) vocational schools; (e) intermediate schools; (f) extension wor 
organizations; (h) magazines for teachers; and (i) book companies I 
these large divisions is further subdivided and the material appropriat 
} rhe work of compiling this library was done some two years ag t 
.; prevented it being printed at that time. It was mimeographed in order t 
ty be placed in the hands of the teachers. In his letter to us Mr. Pi 
" “t following statement: “We propose to revise it from time to time ar 
a now with the hope that we will get suggestions and changes whi 
+ edition a little improvement on the preceding one. Any suggestions 
: to you in the way of eliminations, additions, substitutions, or changes 
ay preparation of the list, will certainly be most gratefully received.” 
ee” The list, as it stands, is valuable to any of our readers. We suggest t 


tendents of schools and research directors write Mr. Pillsbury for a 


received it, show their appreciation by sending to him such suggestions 
to them. 
A Report on the Conditions of the Teaching of English in the Se 
ne of New Jersey (published by the New Jersey Association of Teachers 
obtainable from the Secretary, Miss Mabel A. Tuttle, | 
English in will be of interest to al! those concerned with high-scho« 


ie Secondary for two reasons: First, it presents in small compass a 

os Schools survey of the English situation in a state, treating deta 

. curriculum, methods, etc. Second, it presents most frank 

* of the English teachers themselves on these questions 

. In addition, the form of the report lends itself to ready compreher 
summary gives a bird’s eye view of the situation, then each point 

. numerous representative quotations from the questionnaires on w : 

ge based, and finally a schedule of eighteen “Recommendations” gives 
the standards and conditions which the teachers as a body think should pre 

q school English teaching. With so much dissatisfaction abroad in regard t 

ce of English work, all those concerned should take this opportunity of se 

a insight into existing difficulties and of learning what remedies an act 

teachers have tried E. W. Dot 


University of Illinois 
A Different Kind of Report Card 


Superintendent E. B. Sellew of Middletown, Connecticut, has furnish« 
copy of his special report to the Board of Education and to parents of 
Middletown schools. Since it is a radical departure from the usual form of r 


or leaflet, it was thought that our readers will be interested in it 
rhe report is a four-page folder. The first page contains a black s 
name of the parent to whom the report is being sent and a general explanation o! the 


i 


| 


e of school work with a plea for cooperation. 


re 


e 
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Page two lists the subjects 

gh school together with the total number in each class and the number 
arious grades or marks. For example, English I B, which means the first 

first-vear English, had 248 members, 47 of whom received grades of 90 
eived 85 to 89, 105 received 75 to 84, 37 received 70 to 74, 10 received 60 
ne received below 60 

of 85 to 100 are designed as honorary grades while any grade below 70is a 


rhe group in which the child is located is indicated by a red line. This 


tention of the parent vividly to the number of students in the same grade 


s three and four give additional information concerning the schools, page four 


ild and to the number who received marks higher or lower than his child 


e school census by grades and the residence of high-school pupils with per- 


re paying tuition 
e the report may be somewhat difficult for many of the parents to read, it is 


g because of the large amount of information which is thus placed in 


patrons of the school. 


A Few Data on the Use of the Stanford Revision 
of the Binet-Simon Tests by Halves 


ropos of the article in the September issue of this journal by Messrs. Otis 


n, the following data are submitted upon some of the same points covered 


le. In the course of several years of testing the writer accumulated a 


f complete records of tests of pupils and became interested in making a com- 


etween the pupils’ mental ages computed from the first and second halves of 


Chat is, each pupil’s test record was divided into two parts, one represent- 


} 


erformance upon the first three or four, as the case may be, of the tests for each 


ge level and the other his mental age as based upon the last three or four tests 
uze. In doing this each test was, of course, given weight for just twice the 
f months given when all the tests are used together. At the time of testing 


i} 


rhe records of 182 pupils were complete so that they could 


heir records and hence the giving of the tests could have 


hose records are here treated, the writer had no thought of making such a 


been in no way 
such a plan 


be included in this 


These pupils were well distributed through all the eight elementary grades 


ntl 


ntal ages ranging from four years and eight months to seventeen years and 


After dividing their records into first and last halves by years as de- 


| above, the ages by the first half range trom four years to sixteen years two months 


the second half from five years four months to eighteen years two months 


} 


edian age by the second half is 2.8 months higher than that by the first half 


erage is 4.8 months higher. This latter figure seems to be unduly affected 


few rather freakish cases most of which occur at the mental ages of four and five 


even and twelve. Except for these there is no apparent tendency for the age 


f the pupils to make very much difference in their comparative mental ages 


e first and second halves of the tests. 
rhe following table gives the total distribution o: differences in ages bet ween the 


alves. 


Positive differences mean that the ages by the second half are greater. 


n 

he 
es 4 

— 
the hands of 
q 

er 
ft 

I 

i 
} 
e 

} 


438 JOURNAL EDUCATIONAL RESEARCH | iN 


DIFFERENCES BETWEEN MENTAL AGES a 
BY THE FIRST AND SECOND — 
HALVES OF THE TESTS \" 


Months |Number of Cases 


24-21 l 
— 20-17 | 
16-13 0 
§ 
= & 5 17 
~ 1 25 
0 23 
] } 33 
§ 26 
+ 9-12 22 
+13-16 10 
4-17-20 
+ 21-24 4 
+ 25-28 l 
29-32 2 
33 36 2 
+ 37-40 0 \ 
+41-44 
+45-48 l 
Total 182 


As is stated above the median difference when signs are taken ir 
is 2.8 months. Neglecting signs and merely considering the absolute 
differences, the median difference is 5.5 months. The average absolut: 
8.2 months, being made much larger than the median by a few rather ¢ 
It will be noted that the seven greatest differences are all differences by w 
ond half gives a greater age than the first half. Also these seven are scatter 
six different age levels, so it is apparent that the tests at any one age are 
here. The unusual results from the tests at ages four and five and ele 
which were referred to above were not due to a few such extreme differer 
larger number of differences of from eight to sixteen months 

[he product-moment coefficient of correlation between the ages 
halves is .92 with a P. E. of .01. The probable error of measurement' is { 
months. This agrees very closely with the median absolute differ 
months mentioned above, and also is in substantial agreement with the 
by Otis and Knollin. This probable error of measurement is between f | 
percent of the average mental age. This may be compared with seven pe 
is the smallest probable error of measurement of any group intelligence te 
writer has noted 

Cc. W 


University of lilinois 


? The Probable Error of Measurement is obtained by the formula P.E.M.=—.6745¢ V |-r 
average of the two standard deviations is used. r is the coefficient of reliability, that is, the coesces! 
of correlation between the first balf and second half. 
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‘National Assoriation of Directors uf 
Educational Research 


(E. J. ASHBAUGH, Secretary and Editor) 


| 
bids, Michigan.— Charles D. Dawson, Assistant Su] 
earch, has sent us a study of the marks given hig 
ester of the present year Grand Rapids has t 


4 percent basis to a five-letter basis \ rather extensive 


ving that the whole system of marking passing pupils between 75' 


entific because the best and the poorest pupils often diffe 
,e different marks within these 25 units were not evenly 
svstem gives the marks, A, B, C, D, and F and ‘ 
10.5. 30.0, 30.0, 17.0, 9.5, and 3.0 respectivel) 
ward the upper end with the excey tion of the E 
ness increases from the 9th to 12th gra 
ith the theory that the successive grades in 
i greater selection 
teal of variation is shown in the distribution of marks in the 
It is stated, that “This is due mainly to variations in the type of 
the different classes are made up, to the personal equation of the 
the marking, and to the degree of ith iIties of the work necessary to 
irk in the different subjects ” It is suggested that the tea her 
up of failures in their subjects as well as confer with one anot 
the scale 
nterested in making a study of their own distribution of marks, mi 


Dawson for a copy of this report 
t Allis. Wisconsin.—T. L. Torgerson, Director of the Departmen 
Measurements, has devoted Bulletin No. IT of his department t 
~ He states that the bulletin is issued to give 
§ the scope and aims in the field of tests and measuremen 
to general intelligence and some fundamental terms 
+t forth. The following statement is under 
intended to be the key note in the measuremen 
{ the West Allis schools this year will be measure 1 
1] or standard for each pupil to reach is an a 
ency.” 
lis review of the work last year shows measuremen|! 
sition. arithmetic, and algebra. Statements ; 
btained. and reaction of teachers to remedial w 


» was also done, and the following statement Is made concerning the utilizi 


Mental age of the pupil used as a basis for grade placement 
Intelligence quotient of the pupil used as a basis for classification 
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Intelligence and achievement compared to determine the achiever 
yupil 


4. Aid for individual diagnosis 


5. Permanent record for future diagnostic purposes 

6. Discovery of sub-normal pupils 

\ tentative outline of work for the year 1921 1922 ir cludes lor t 
testing program in geography, history, and algebra; a testing prograr 
ment of spelling, silent-reading, arithmetic, and handwriting: dia 
Language test; a prognostic test of mathematical ability; a study 
of the high-school pupils; testing for the appreciation of poetry ir 
school; one group intelligence test and a study of the distribution of ma 

In the elementary schools a program of testing for remedial work 
reading, arithmetic, handwriting, language, and oral reading will be 
will also be intelligence testing, a study of school marks, and a « 
study of the promotion of pupils on the basis of mental age. Closer su 
special help period for individual instruction will be given. 

Denver —Miss Emma M. Brown, Director of the Department 
and Standards, has recently sent us two bulletins. Bulletin No. 2 
programs. Summarized, the general conclusions reached after a study 
daily programs are as follows 

1. There is a lack of uniformity as to accuracy, distribution of sul 
and number of pupils 

2. Due to the fact that programs are not made accurately and 
much confusion as to interpretation 
3. A study of the principles involved would be helpful alike to 
teachers 

4. Supervision of program making by the principal tends effective 
work of the school in the following ways: (a) distribution of teachers 
ing time, number of pupils, and free time; (b) distribution of puy 


various subjects; (c) reduction in amount of unsupervised study 


coaching pupils who have been absent, or for helping backward or acc 
e) variation in course of study to meet local needs; (f) provision for mer 
tional testing and guidance; and (g) a more scientific placement of 
tabular material presents data from which these conclusions were draw 
bulletin is suggestive to those who wish to improve the daily programs 
their school systems 

Bulletin No. 3 reports two tests in spelling in elementary and juni: 
grades to inclusive, September 1920 and January 1921 
only presents in figures and graphs the conditions in the various Denver 
in the city as a whole, but also includes deductions, suggestions for imy 
some general principles for the benefit of the teachers. 

The following are some of the results 

(1) That girls spelled better than boys; (2) that there was a differ: 
the ability in content and list spelling which gradually decreased in the | 
(3) that locality of school and size of class had little effect; (4) that school 
populations were handicapped in the lower grades, but overcame the handica 


upper grades. 
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suggestions for improvement, the following statements, 


Secure automatic accuracy for words of greatest freque 


and adult correspondence 
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i The other bulletin deals with reports on the Courtis Arithmetic Tests Thy 
port shows that the city-wide medians were practically the same in May 1921 as ip 
May 1920. Of all the classes of the « ity 42.5 percent scored below norma! 


/ lowing goal is set: “Every class should aim at the standard. Slow lass 


reach the lowest normal score in each grade. average classes should reach ¢} 


and strong classes may score somewhat above standard. However. it j 


lasses should not exceed the upper normal scores in any grade.” The ipper » 
“a | normal scores referred to are upper and lower quartiles. The author al 
attention of all teachers and principals to the fact that one school wh 
‘ been in the lowest quartile until last year had brought all grades to norma 
Pe } “This splendid piece of work was done in one year under only fair working tions 
and with average pupils.” 
. a Cannot our readers furnish us with similar re« ords? 


University of Michigan.—Last spring, the University of Michigan, Bureay of 
4 
: Tests and Measurements, sent out a bulletin of inquiry to the school pe f the 
Ss State asking for guidance in regard to testing programs. The tabulation of the replies 


gives an interesting index of the preference which school people in that stat 


iting in this field. The tabulation follows 


Of 47 replies, 46 wish to include an intelligence test 
“42 “25 wish to include at least Grades III to VIII in the pr 
wish to include six or more of the school grades, 


“31 “29 wish to include three or more school subjects, and 


include four or more, though sometimes these four include 


ligence test 


31 wish to use the Courtis Arithmetic Test 
"33 - 19 wish to use the Monroe Silent Reading Test. 
“47 “ 24 wish to use the Ayres Spelling Scale. 
‘29 ‘19 wish to use the Ayres Handwriting Scale 
‘27 “19 wish to use the National Intelligence Test 
“ 47 “29 are willing to leave it to the Bureau to decide the order 


the tests shall be given 
* 47 “44 agree to forward results to the Bureau 


On the basis of this information, the Bureau arranged a program { 


grades three to eight which included courtis Supervisory Arithmetic Tests, Monroe 


Silent Reading Tests, Buckingham Extension of the Ayres Spelling Scale and the 


National Intelligence Tests, 
We shall look forward with interest to the report on this program and we shall 
welcome reports of similar programs from other Direc tors 
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We take pleasure in announcing 


THE TWENTY-FIRST YEARBOOK 


of the 


National Society for the Study of Education 


‘The Twenty-First Yearbook of the National Society for the Study 
of Education will deal with the subject of intelligence tests, discuss- 
ing their nature and history, the general principles underlying their 
use, and the administrative use of intelligence tests from the kinder- 
garten through the university. 


‘Among the authors of the Twenty-First Yearbook are: 
E. L. Thorndike, Teachers College, Columbia University. 

S. S. Colvin, Brown University. 

H. W. Holmes, Graduate School of Education, Harvard University. 
G. M. Whipple, University of Michigan. 
Agnes L. Rogers, Goucher College. 

Warren K. Layton, Public Schools, Detroit. 


The standing of the authors will make the Twenty-First Yearbook 
one of the authoritative publications of 1922 on the subject of intelli- 
gence testing. 


‘Though the Twenty-First Yearbook is satisfyingly thorough in its 
complete discussion of its subject, it is written in a clear style that 
will win favor with the thousands of teachers who are desirous of 
learning as much as possible concerning the testing of intelligence. 


‘The Twenty-First Yearbook will be displayed for the first time at 
Chicago, February 25th, 1922, in the Gold Room of the Congress 
Hotel. Part II of the Twenty-First Yearbook will be discussed 
Tuesday evening, February 28th, in the Auditorium Theatre at a 
joint meeting of the National Society for the Study of Education and 
the Department of Superintendence of the N. E. A. 


Advance orders should be sent to the 


PUBLIC SCHOOL PUBLISHING COMPANY 


BLOOMINGTON, ILLINOIS 
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THREE NOTABLE BOOKS FOR TEACHERS’ 
READING AND STUDY 


The Psychology of Arithmetic 
By EDWARD L. THORNDIKE 
Professor of Educational Psychology, Teachers College, Columbia University 


Recognizing that the ordinary view of the arithmetical learning is obscure 
er inadequate as to specify knowledge desired, terminology of instruction 
and ability to apply what is learned in arithmetic to the quantitative 
problems of life, Dr. Thorndike has made a brilliant analysis of the 
subject of arithmetical teaching and study to show what has been done 
erroneously or inadequately, and what should be done in reform. 


Fundamentals of Education 
By BOYD H. BODE 

Professor of the Philosophy of Education, Ohio State University 

Edited by William C. Bagley for Tam Tracuens’ Sens 


What should be the aims and ideals back of a teacher’s effort? What should 
present day education attempt? What standards of value should determine 
the materials of the curriculum, the organization of the school, the methods 
of instruction, the intimate and influential relations of the teacher with his 
pupils? A study of the geste ad of education will not answer al! these 
questions but it should do much to help the teacher to answer them for 
himself. Professor Bode has succeeded admirably in making this quality 
the dominating feature of thie book. 


A Guide to the Teaching of Spelling 
By HUGH CLARK PRYOR 
Northern Normal and Industrial School, Aberdeen, South Dakota 


and 
MARVIN SUMMERS PITTMAN 
Michigan State Normal College 


This book is an attempt to evaluate and make available for busy teachers 
the results of recent investigations and studies in the subject of spelling. 
It indicates clearly the possibilities and the difficulties of improvement in 
spelling, outlines the mode of proceduré, and suggests the proper motiva- 


, Coming Soon 


Book: THE INTELLIGENCE OF HIGH SCHOOL SENIORS 
Boreas; TEACHING TO THINK 
Ingraham: THE COMMUNITY 

Send for the Complete Educational Catalogue 


The Macmillan Company 


New York 
Boston 


Atlanta San Francisco 
Chicago Dallas 


tion. 
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